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Preface 


This  report  documents  the  development  of  the  Integrated  Sinu- 
lation  Evaluation  Model  Prototype  (ISEM-P).  This  research  program 
began  in  1974  as  a  project  to  determine  the  feasibility  of  building 
a  descriptive  model  of  the  Air  Force  Manpower  and  Personnel  System 
(AFMPS).  The  project  has  seen  the  initiation  of  a  spin-off,  stand¬ 
alone  effort  in  the  area  of  estimating  parameters  and  modeling  the 
relationships  between  the  AFMPS  and  the  national  labor  market.  The 
primary  product  has  been  the  development  of  a  large-scale  simulation 
model  of  the  AFMPS  which  describes  and  analyzes  the  information  flows 
and  decision  dynamics  of  the  various  subsystems  comprising  the  total 
AFMPS.  The  model  incorporates  state-of-the-art  simulation  techniques 
using  the  SIMSCRIPT  II. 5  simulation  language  and,  although  on  a 
reduced  scale,  does  provide  a  reasonable  representation  of  the  AFMPS. 
Much  of  this  work  has  been  completed  under  Project  2077,  Task  02, 
and  the  labor  market  research  is  being  conducted  presently  under 
Project  7719,  Task  20.  This  entire  research  effort  is  encompassed 
under  the  Force  Acquisition  and  Distribution  Thrust  and  specifically 
the  Acquisition,  Classification  and  Assignment  Subthrust. 
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1.0  INTRODUCTION 


The  Integrated  Simulation  Evaluation  Model  Prototype  (ISEM-P)  is 
a  computer  program,  written  in  the  SIMSCRIPT  II. 5  language,  which  sim¬ 
ulates  the  basic  planning  activities  and  decision-making  procedures 
involved  in  the  Air  Force  Manpower  and  Personnel  System  (AFMPS).  It 
embodies  a  dynamic  modular  representation  of  the  AFMPS  in  which  aggre¬ 
gate  manpower  planning,  training  program  management,  detailed  personnel 
assignment  scheduling,  and  actual  personnel  flows  are  characterized 
as  integrated,  interdependent  activities  that  determine  the  status 
of  groups  of  personnel  and  thereby  control  the  evolution  of  the  force 
structure  over  time. 

ISEM-P  has  been  designed  as  a  prototype  for  a  large-scale  model 
—  the  Integrated  Simulation  Evaluation  Model  (ISEM)  —  that  would 
serve  as  an  analytic  tool  in  AFMPS  planning  and  policy  formulation. 

In  particular,  ISEM  would  be  useful  for  predicting  and  evaluating  the 
impacts  of  changes  in  policies,  procedures,  and  environmental  condi¬ 
tions  on  the  performance  of  the  entire  AFMPS.  One  of  the  primary 
goals  in  developing  ISEM-P  has  been  to  create  an  operational  computer 
program  that  would  demonstrate  the  technical  feasibility  of  the  ISEM 
concept  and  suggest  the  potential  usefulness  of  a  larger,  more  compre¬ 
hensive  version  of  the  model. 

Achieving  this  state  of  model  development  has  involved  performing 
three  evolutionary  research  activities: 

1.  Design  of  a  practical  methodology  for  simulating  the 
behavior  of  the  AFMPS,  resulting  in  establishment  of 
the  basic  structure  of  ISEM. 

2.  Programming  and  implementation  of  an  initial  version 
of  the  model  on  the  UNIVAC  1108  computer  at  the  Air 
Force  Human  Resources  Laboratory  (AFHRL). 

3.  Evaluation,  testing,  augmentation,  and  improvement 
of  the  initial  formulation  to  arrive  at  the  current 
configuration  of  ISEM-P. 

Having  accomplished  these  tasks,  it  is  now  appropriate  to  examine  the 
robustness  of  the  representation  of  the  AFMPS  contained  in  the  proto¬ 
type.  Consequently,  this  report  summarizes  the  results  of  an  exten¬ 
sive  sensitivity  analysis  of  ISEM-P:  an  in-depth  analysis  of  the 
changes  in  simulated  performance  that  result  from  systematic  adjust¬ 
ments  of  the  values  of  program  parameters  associated  with  key  issues 
concerning  the  structure  of  the  prototype. 
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To  provide  an  adequate  understanding  of  the  activities  simulated 
in  ISEM-P,  a  brief  description  of  the  organization,  functions,  and 
operation  of  the  AFMPS  is  presented  in  Section  2.0.  Then,  to  establish 
a  suitable  perspective  for  interpreting  the  sensitivity  analysis  and 
its  implications.  Section  3.0  contains  a  more  detailed  explanation  of 
the  1SEM  concept,  the  structure  and  operation  of  ISEM-P,  and  the  resul¬ 
tant  relationship  between  the  prototype  and  the  concept. 

The  conceptual  framework  and  analytic  methodology  exployed  in  the 
sensitivity  analysis  are  discussed  in  the  next  two  sections.  The 
results  derived  by  applying  the  methodology  to  assess  the  sensitivity 
of  the  prototype's  performance  within  the  context  of  the  conceptual 
framework  are  then  summarized  in  Section  6.0.  The  conclusions  and 
recommendations  emerging  from  the  results  of  the  sensitivity  analysis 
are  reported  in  the  final  section. 
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2.0  OVERVIEW  OF  THE  AIR  FORCE 

MANPOWER  AND  PERSONNEL  SYSTEM 


To  appreciate  the  logic  underlying  the  structure  and  operation  of 
ISEM-P,  it  is  first  necessary  to  obtain  a  basic  understanding  of  the 
AFMPS:  its  goals  and  responsibilities,  its  operating  environment, 

the  constraints  on  its  actions,  and  its  organizational  structure.  A 
simplified  representation  of  the  AFMPS  and  the  environment  in  which 
it  functions  is  presented  in  Figure  1. 

The  AFMPS  is  responsible  for  the  procurement,  development,  main¬ 
tenance,  and  deployment  of  the  human  resources  available  to  the  Air 
Force.  Thus,  it  exercises  substantial  control  over  the  fundamental 
characteristics  of  occupational  life  in  the  Air  Force:  where  people 
are  stationed,  what  jobs  they  perform,  and  what  training  they  receive. 
The  AFMPS  also  exerts  considerable  influence  over  entry  into  and  exit 
from  the  service  through  the  actions  it  takes  at  the  control  points 
associated  with  airman  and  officer  procurement  and  retention.  Most 
importantly,  it  provides  the  essential  link  between  people  and  jobs 
that  enables  the  Air  Force  to  accomplish  the  objectives  established 
in  the  Five-Year  Defense  Plan  (FYDP). 

Essentially,  the  goals  and  objectives  driving  the  AFMPS  consist 
of  providing  people 

1.  Of  the  right  kind 

2.  At  the  right  place 

3.  At  the  right  time 

4.  In  sufficient  quantity 

5.  To  staff  the  mission  functions 

-  Required  to  support  budgeted  Air  Force  programs 

-  According  to  established  manpower  standards 

6.  At  lowest  cost 

The  ability  of  the  AFMPS  to  achieve  these  goals  and  objectives  is 
limited,  however,  by  three  basic  sets  of  organizational  and  environ¬ 
mental  constraints: 

1.  Authorization  ceilings 

2.  Policy  directives 

3.  Exogenous  labor  market  forces 
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Figure  1.  The  AFMPS  environment. 


Budgeted  programs  basically  correspond  to  various  missions  the  Air 
Force  is  charged  with  performing,  such  as  weapons  systems  operations. 

The  missions  are  assigned  to  particular  bases,  or  other  installations; 
and  require  the  performance  of  a  number  of  specific,  sometimes  highly 
technical,  jobs.  For  the  Air  Force  to  accomplish  these  missions,  the 
right  amounts  of  personnel,  possessing  an  appropriate  mix  of  skills 
and  experience,  must  be  available  at  the  bases. 

Assuring  continued  personnel  availability  is  an  inherently 
dynamic  process.  Supplying  the  desired  people  entails  providing  the 
necessary  training  and  transportation.  Further,  the  characteristics 
of  the  available  personnel  change  over  time  as,  for  example,  some 
people  become  more  experienced,  some  change  career  ladders,  and  some 
leave  the  force.  The  demand  for  personnel  also  changes  as,  for 
instance,  the  FYDP  is  modified  or  mission  manpower  requirements  are 
revised.  In  response  to  such  changes,  the  system  must  adjust  the 
stock  in  a  timely  fashion  to  remain  in  equilibrium.  Moreover,  as  in 
any  economically-constrained  situation,  the  system  must  strive  to 
limit  the  costs  incurred  in  its  operation. 

To  achieve  these  goals,  the  AFMPS  organization  is  operationally 
partitioned  into  three  distinguishable  components:  manpower,  personnel, 
and  training.  Organizationally,  the  manpower  and  personnel  components 
are  both  administered  by  the  Manpower  and  Personnel  Command  (MPC) ; 
while  training  is  the  responsibility  of  the  Air  Training  Command  (ATC) . 
Functional ly,  however,  all  three  components  can  realistically  be 
regarded  as  independent  entities. 

The  manpower  component  is  responsible  for  determining  the  needs 
for  skilled  personnel  in  various  occupational  specialties,  at  various 
levels  of  expertise  and  authority.  These  effective  demands  for  per¬ 
sonnel  are  derived  from  established  plans  to  staff  particular  Air  Force 
mission  elements  at  specific  geographic  locations,  based  on  known 
mission  technologies,  labor  productivities,  and  defense  plan  budgets. 

The  personnel  component  is  responsible  for  maintaining  adequate 
supplies  of  personnel  who  have  suitable  skills  and  experience  who  are 
appropriately  located  geographically  to  satisfy  the  needs  defined  by 
the  manpower  component.  Moreover,  the  demands  for  personnel  must  be 
filled  on  a  time  schedule  that  ensures  continuing  combat  readiness 
and  guarantees  the  availability  of  sufficient  personnel  to  meet  antic¬ 
ipated  future  needs  through  established  career  progression  sequences. 

The  training  component  is  responsible  for  recruiting  and  develop¬ 
ing  new  personnel  to  replenish  or  augment  existing  supplies  and  for 
furnishing  the  education  that  enables  current  personnel  to  acquire 
new  skills  and  become  more  proficient  at  old  ones.  Through  these 
activities,  a  dynamic  mechanism  is  provided  for  reconciling  skilled 
personnel  supplies  and  demands  over  time. 


Through  the  years,  each  component  has  developed  objectives,  per¬ 
formance  measures,  methods,  and  procedures  that  are  well  suited  to  its 
perception  of  its  own  responsibilities.  Consequently,  it  is  difficult 
for  any  single  Air  Force  organization  to  have  comprehensive  understand¬ 
ing  and  control  of  the  operation  of  the  AFMPS. 

Yet,  obviously,  the  three  components  of  the  AFMPS  are  interrelated, 
and  their  performance  can  be  highly  interdependent.  For  example,  modi¬ 
fication  of  the  procedures  employed  by  any  one  of  the  components  can 
have  substantial  effects  on  the  ability  of  the  other  components  to 
fulfill  their  responsibilities.  Thus,  it  seems  desirable  to  develop  a 
capability  to  anticipate  and  adjust  appropriately  for  the  system-wide 
implications  of  changes  in  policies,  procedures,  and  environmental 
conditions  affecting  the  AFMPS.  This  is  the  precise  reason  why  ISEM 
has  been  designed  as  a  planning  and  policy  formulation  tool,  and 
ISEM-P  has  been  developed  as  an  exploratory  device. 


3.0  THE  STRUCTURE  OF  ISEM  AND  ISEM-P 


The  central  concept  underlying  ISEM  is  that  the  manpower,  per¬ 
sonnel,  and  training  components  of  the  AFMPS  can  be  viewed  as  parts  of 
a  large  in format  ion- feedback  control  system.  From  this  perspective, 
a  simulation  model  could  be  developed  that  would  depict  the  impact  of 
one  component  on  the  others  —  and  on  the  system  as  a  whole  —  in  terms 
of  the  changes  that  occur  in  personnel  supplies  and  the  responses  that 
these  changes  stimulate.  Ultimately,  as  illustrated  in  Figure  2,  ISEM 
would  consist  of  five  elements: 

1.  A  Policy/Information/Control  (PIC)  Module,  represent¬ 
ing  the  data  gathering,  information  processing,  and 
decision-making  aspects  of  the  AFMPS. 

2.  A  Personnel  Force  Structure  Module,  representing  the 
stock  of  Air  Force  personnel,  aggregated  into  as  many 
categories  as  are  relevant  to  the  PIC  decision  pro¬ 
cesses. 

3.  Training  and  Transportation  Pipelines,  representing 
the  flows  of  personnel  from  one  category  to  another, 
and  the  processes  that  implement  these  flows. 

4.  A  National  Labor  Market  Module,  representing  the 
changing  mix  of  sources  and  sinks  for  personnel  in 
the  world  outside  the  Air  Force. 

5.  Evaluation  Systems,  comprising  a  collection  of  mea¬ 
surement  and  report  generation  procedures  displaying 
the  performance  of  the  AFMPS  and  each  of  its  compon¬ 
ents  over  time. 

The  principal  use  intended  for  ISEM  would  then  be  to  predict  the  system- 
wise  implications  of  changes  in  PIC  policies  and  procedures  and  in 
national  labor  market  conditions,  for  use  in  AFMPS  planning  and  policy 
development  efforts. 

In  contrast,  the  purpose  of  ISEM-P  has  been  to  develop  a  working 
prototype  of  the  ISEM  concept.  As  a  prototype,  the  design  of  ISEM-P 
corresponds  closely  to  the  structure  formulated  for  the  full  ISEM. 
However,  to  allow  an  operational  system  to  be  developed  relatively 
soon  and  inexpensively,  the  elements  of  the  model  have  been  somewhat 
scaled-down  and  simplified  in  the  prototype.  In  fact,  two  elements 
--  the  National  Labor  Market  Module  and  the  Evaluation  Systems  — 
have  been  omitted  entirely.  The  resultant  relationship  between  ISEM-P 
and  ISEM  is  shown  in  Figure  2. 
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Figure  2.  ISEM  and  ISEM-P  elements 


3.1  ISEM-P  Personnel  Force  Representation 


The  most  important  element  in  any  personnel  planning  model  is  the 
representation  chosen  for  the  stock  of  personnel.  This  representation 
establishes  the  level  of  detail  contained  in  the  model  and,  hence, 
almost  completely  determines  the  amount  of  input  data  required,  the 
kinds  of  decisions  susceptible  to  simulation,  and  the  types  of  ques¬ 
tions  amenable  to  analysis.  ISEM-P,  like  ISEM,  is  an  aggregate  model; 
i.e.  ,  it  deals  with  groups  of  personnel  rather  than  individuals.  Every 
personnel  group  is  characterized  by  one  or  more  of  five  properties: 
skill,  grade,  year  group,  base,  and  time-on-station. 

Skill  is  designated  by  a  code  indicating  the  type  of  job  a  group 
of  personnel  is  capable  of  performing.  ISEM-P  skill  codes  correspond 
fundamentally  to  Air  Force  Specialty  Codes  (AFSCs)  used  by  the  AFMPS 
to  categorize  occupational  expertise.  However,  only  those  skills 
required  by  the  missions  represented  in  ISEM-P  have  been  included  in 
the  prototype.  Moreover,  most  ISEM-P  skill  codes  constitute  a  merger 
of  several  AFSCs:  some  at  the  general  career  field  level  corresponding 
to  two-digit  AFSCs,  others  at  the  career  group  level  associated  with 
three-digit  AFSCs,  and  the  remainder  at  more  detailed  specialty  levels. 
Skill  level,  the  degree  of  proficiency  designated  by  the  fourth  digit 
of  an  airman  AFSC,  is  not  explicitly  represented  in  the  prototype. 
However,  skill  level  is  strongly  correlated  with  grade.  Altogether, 
there  arc  51  airman  skill  codes  and  40  officer  skill  codes  included 
in  ISEM-P.  The  code,  AFSC,  and  title  of  each  skill  contained  in  the 
prototype  is  listed  in  Table  1 . 

Within  each  skill,  personnel  are  stratified  by  grade,  or  rank. 

As  with  the  skill  codes,  ar.  ISEM-P  grade  usually  represents  more  than 
one  actual  Air  Force  grade.  The  correspondence  is: 


ISEM-P 

Airman 

Officer 

Grade 

Grades 

Grades 

1 

El  and  E2 

2nd  Lieutenant 

3 

E3 

Lieutenant 

5 

E4  and  E5 

Captain 

7 

E6  and  E7 

Major 

9 

E8  and  E9 

Lt  Colonel  and  Colonel 

Civilian  personnel  management  is  not  simulated  in  the  prototype. 
Hence,  there  are  no  civilian  grades  in  ISEM-P. 

A  year  group  specifies  the  number  of  years  a  group  has  served  in 
the  Air  Force,  and  is  essentially  analogous  to  the  AFMPS  measure  of 
Total  Active  Federal  Military  Service  (TAFMS) .  Thirty  year  groups 
are  delineated  in  the  prototype. 
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Table  1:  ISEM-P  Skill  Codes 


Each  base  in  ISEM-P  represents  an  actual  Air  Force  base.  It 
possesses  all  pertinent  geographic,  organizational,  and  tour-length 
characteristics  of  its  real  counterpart.  The  missions  assigned  to  the 
simulated  bases  correspond  to  the  missions  attached  to  the  analogous 
real  bases,  and  the  groups  of  personnel  associated  with  the  bases  in 
the  prototype  conform  to  the  personnel  actually  assigned  to  the  appli¬ 
cable  mission  functions  at  the  real  bases.  While  the  full  ISEM  would 
embody  all  bases  and  other  Air  Force  facilities,  17  bases  have  been 
selected  as  a  reasonable  set  for  inclusion  in  the  prototype.  Of  these 
17  bases,  13  are  located  in  the  Continental  United  States  (CONUS),  two 
in  Europe,  and  two  in  the  Pacific.  Moreover,  of  the  13  CONUS  bases, 
three  are  affiliated  with  ATC,  three  with  the  Military  Airlift  Command 
(MAC),  three  with  the  Strategic  Air  Command  (SAC),  and  four  with  the 
Tactical  Air  Command  (TAC) .  A  complete  list  of  the  bases  included 
in  the  model,  their  geographic  locations,  and  their  organizational 
affiliations  is  presented  in  Table  2. 

Time-On-Station  (TOS)  is  the  number  of  months  a  person  has  resided 
at  a  base.  This  property  is  used  by  the  AFMPS  to  determine  when  the 
person  may  be,  or  must  be,  moved  to  another  base.  Within  ISEM-P,  a 
TOS  frequency  distribution  is  dynamically  maintained  for  each  personnel 
group  at  each  base . 

The  structure  of  the  personnel  force  at  any  time  is  then  repre¬ 
sented  in  the  prototype  in  terms  of  the  composition  of  the  stock  of 
personnel  relative  to  the  preceding  fiv®  properties:  skill,  grade, 
year  group,  base,  and  TOS.  Thus,  these  are  the  basic  dimensions  within 
which  the  representations  of  Air  Force  decision  rules  contained  in 
ISEM-P  operate. 


3.2  ISEM-P  Decision  Types 


Of  all  the  various  kinds  of  decisions  routinely  made  by  the  AFMPS, 
six  basic  types  are  represented  in  the  PIC  Module  of  the  prototype: 

1.  Personnel  authorization  decisions  determining  the 
mix  of  personnel  required  to  support  budgeted 
missions,  and  reconciling  these  requirements  with 
the  number  of  personnel  authorized  in  the  FYDP. 

2.  Airman  and  officer  procurement  decisions  evoking 
the  flow  of  entrants  into  the  force,  and  reflected 
in  increases  in  the  number  of  junior  personnel  in 
all  skills  at  all  bases. 

3.  Promotion  decisions  affecting  the  distribution  of 
the  force  across  grades. 
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Table  2:  ISEM-P  Bases 
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4.  Training  decisions  providing  for  Che  distribuCion 
of  personnel  among  skills. 

5.  Transfer  decisions  producing  the  distribution  of 
the  force  over  bases, 

6.  Separation  decisions  producing  the  flows  of  per¬ 
sonnel  out  of  the  force,  and  hence  reducing  the 
number  of  people  in  various  groups. 

None  of  these  decisions  directly  alters  the  distribution  of  the 
force  across  year  groups:  the  force  simply  gets  older  each  year. 
However,  recruiting,  promotion,  training,  and  separation  decisions  all 
affect  this  distribution,  or  some  disaggregation  of  the  distribution, 
indirectly.  Similarly,  TOS  is  not  directly  controllable,  although  its 
distribution  across  bases  can  be  manipulated  through  appropriate 
transfer  decisions. 

The  first  five  types  of  decisions  are  organizational  decisions 
expressly  taken  to  promote  the  objectives  of  the  AFMPS.  Conversely, 
the  last  type,  separation  decisions,  are  principally  actions  taken 
by  individual  Air  Force  personnel  to  serve  their  own  private  inter¬ 
ests.  They  are  not  directly  determined  by  the  AFMPS,  and  hence  may¬ 
or  may  not  be  compatible  with  AFMPS  objectives. 

The  representations  of  decision  rules  included  in  ISEM-P  are  all 
essentially  deterministic.  Stochastic,  or  random,  elements  have  been 
included  in  only  a  few  simulated  decision  rules,  and  these  elements 
merely  establish  default  conditions  to  deal  with  situations  that 
should  never  arise  overtly  in  the  prototype,  but  might  evolve  through 
some  circuitous  sequence  of  events. 


3.3  ISEM-P  Decision-Making  Levels 


Management  decisions  are  made  at  numerous  levels  in  the  AFMPS, 
including  the  Air  Staff,  major  command,  and  base  levels.  Each  level 
operates  on  a  different  time  scale,  considers  a  different  planning 
horizon,  and  uses  a  different  aggregation  of  the  force  structure  in 
its  decision  making. 

Two  levels  of  decision-making  are  represented  in  ISEM-P.  They 
have  been  implemented  as  two  distinct  submodels:  the  aggregate  sub¬ 
model  and  the  assignment  submodel. 

The  aggregate  submodel  operates  on  a  yearly  cycle.  It  develops 
and  actuates  long-range  force  structure  plans  for  a  horizon  period 
corresponding  to  the  end  of  the  current  simulated  year.  In  this  plan¬ 
ning  process,  the  stock  of  personnel  is  described  in  terms  of  an  array 


called  the  inventory,  whose  three  dimensions  are  skill,  grade,  and  year 
group. 

Within  ISEM-P,  the  FYDP  is  represented  as  five  yearly  mission  plans 
and  five  annual  authorization  ceilings.  The  mission  plan  summarize 
the  programs  included  in  the  FYDP  by  stating  which  missions  are  to  be 
attached  to  which  bases  during  each  simulated  year.  The  authorization 
ceilings,  conversely,  express  the  budgetary  restraints  specified  in 
the  FYDP  in  terms  of  the  authorized  end-strengths  for  airmen  and  for 
officers  in  each  simulated  year.  Authorized  end-strength  is  the  max¬ 
imum  total  number  of  personnel  allowed  to  be  in  the  force  performing 
mission  functions  at  the  end  of  a  year. 

Each  simulated  year,  the  aggregate  submodel  receives  as  inputs 
the  mission  plan  and  authorization  ceilings  for  that  year,  and  proceeds 
to  perform  five  basic  operations.  In  these  operations,  the  submodel 

1.  Converts  the  mission  plan  into  manpower  requirements 
and,  then,  transforms  the  requirements  into  detailed 
authorizations . 

2.  Projects  the  expected  state  of  the  inventory  after 
anticipated  attrition. 

3.  Formulates  promotion,  training,  and  recruiting  plans 
designed  to  change  the  state  of  the  inventory  to 
conform  to  the  detailed  authorizations. 

4.  Removes  actual  separation  losses  from  the  inventory. 

5.  Applies  the  formulated  plans  to  the  inventory. 

This  process  produces  the  inventory  that  serves  as  a  primary  input  to 
the  next  annual  planning  cycle.  The  formulated  plans  and  actual  results 
are  also  passed  as  inputs  to  the  assignment  submodel. 

The  assignment  submodel  operates  on  a  monthly  cycle.  It  develops 
and  implements  short-range  plans  for  personnel  flow  among  bases  for  a 
horizon  period  nominally  9  months  ahead  of  the  current  simulated  month. 
In  this  submodel,  personnel  groups,  identified  by  skill  and  grade,  are 
distributed  among  the  bases  to  derive  the  stock  of  personnel  at  each 
base,  termed  the  base  supply.  Each  personnel  group  within  each  base 
supply  is  further  stratified  by  the  time-on-station  in  the  manner 
described  in  Section  3.1. 

More  precisely,  the  assignment  submodel  converts  the  plans  form¬ 
ulated  for  each  simulated  year  in  the  aggregate  submodel  into  month- 
by-month,  base-by-base  schedules  for  separations,  promotions,  and 
training  assignments.  It  also  schedules  all  transfers  among  bases 
necessitated  by  policies  restricting  the  length  of  overseas  tours. 


and  allocates  newly  trained  personnel  to  bases.  The  schedules  are 
established  for  the  horizon  period  on  the  basis  of  projections  of  base 
supplies  and  base  authorizations  for  that  period.  Then,  the  schedules 
are  applied  to  the  actual  base  supplies  to  simulate  the  resultant  flows 
of  personnel  through  training  and  among  bases. 

Unavoidably,  the  recruitment,  separation,  and,  to  some  extent, 
training  decisions  simulated  in  the  prototype  must  diverge  from  those 
that  would  be  generated  in  the  full  ISEM,  since  the  ultimate  effects 
of  such  decisions  would  strongly  depend  on  interactions  with  the 
National  Labor  Market  Module.  ISEM-P  assumes  that  all  airman  and 
officer  procurement  demands  will  be  fulfilled,  in  terms  of  both  quan¬ 
tities  and  aptitudes.  In  an  analogous  manner,  separations  in  ISEM-P 
are  completely  controlled  by  an  exogenously  supplied  set  of  separa¬ 
tion  rates  for  each  group  in  the  inventory. 

The  basic  operation  of  ISEM-P,  focusing  on  its  two  submodels  and 
their  interrelationships,  is  displayed  schematically  in  Figure  3. 

This  figure  reveals  a  basic  difference  between  the  information-feedback 
opportunities  available  within  the  inventory  and  the  base  supply  plan¬ 
ning  processes.  Because  the  inventory  planning  horizon  corresponds 
exactly  to  the  length  of  the  inventory  planning  cycle,  each  inventory 
plan  developed  in  the  aggregate  submodel  is  based  on  the  actual  state 
of  the  inventory  realized  at  the  end  of  the  preceding  cycle.  In  con¬ 
trast,  the  base  supply  planning  horizon  is  equal  in  length  to  nine 
base  supply  planning  cycles.  Consequently,  each  base  supply  plan 
formulated  in  the  assignment  submodel  necessarily  depends  on  the  plans 
and  projections  developed  for  the  eight  intervening  months  between  the 
current  simulated  month  and  the  planning  horizon.  The  resultant  dif¬ 
ference  in  information-feedback  mechanisms  is  highlighted  in  Figure  3, 
where  a  single  integrative  feedback  loop  appears  within  the  aggregate 
submodel,  while  two  essentially  independent  loops  are  depicted  for  the 
base  supply  planning  and  base  supply  flows  portions  of  the  assignment 
submodel. 

Taken  together,  the  two  component  submodels  of  the  prototype 
simulate  the  interaction  of  all  of  the  AFMPS  goals,  objectives,  and 
constraints  discussed  in  Section  2.0.  However,  each  submodel  addresses 
a  distinct  subset  of  those  concerns.  Moreover,  even  where  both  sub¬ 
models  examine  the  same  issue,  the  manner  in  which  the  issue  is 
resolved  frequently  varies. 

To  enhance  appreciation  of  these  differences,  more  detailed 
descriptions  of  the  two  submodels  are  presented  in  the  next  two  sec¬ 
tions.  The  aggregate  submodel  is  discussed  in  Section  3.4,  and  the 
assignment  submodel  in  Section  3.5. 
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3.4  The  Aggregate  Submodel 


As  its  name  implies,  the  aggregate  submodel  simulates  AFMPS  force 
structure  planning  and  adaptation  at  a  relatively  cumulative  level. 
Essentially,  this  submodel  does  not  consider  the  distribution  of  per¬ 
sonnel  among  bases.  Similarly,  except  to  the  extent  that  cost  consid¬ 
erations  are  reflected  in  Air  Force  program  budgets  and  established 
manpower  standards,  it  is  not  concerned  with  controlling  cost.  Rather 
the  subset  of  AFMPS  goals  and  objectives  simulated  in  the  aggregate 
submodel  consist  of  providing  people 

1 .  Of  the  right  kind 

2.  At  the  right  time 

3.  In  sufficient  quantity 

4.  To  staff  the  mission  functions 

Required  to  support  budgeted  Air  Force  programs 
-  According  to  established  manpower  standards 

As  before,  the  feasibility  of  attaining  the  operative  goals  and  objec¬ 
tives  is  constrained  by 

1.  Authorization  ceilings 

2.  Policy  directives 

3.  Exogenous  labor  market  forces 

Moreover,  as  indicated  previously,  within  the  aggregate  submodel  the 
"right  kind"  of  personnel  are  identified  in  terms  of  skill,  grade,  and 
year  group;  and  the  "right  time"  corresponds  to  the  end  of  the  current 
simulated  year. 

Three  principal  AFMPS  policy  directives  are  embodied  in  the  sub¬ 
model.  When  total  manpower  requirements  exceed  authorization  ceilings 
manpower  policy  establishes  the  priorities  attached  to  different  skills 
in  determining  detailed  authorizations.  Next,  Air  Force  promotion 
policy  stipulates,  for  each  grade,  the  specific  year  groups  from  which 
promotions  into  the  next  higher  grade  may  be  drawn.  Finally,  the  equal 
promotion  opportunity  policy  requires  that  all  airmen  in  any  grade  are 
eligible  for  promotion  on  the  same  terms  regardless  of  the  skill  in 
which  they  have  been  trained.  Representations  of  all  three  of  these 
policies  are  incorporated  into  the  simulated  decision  rules  contained 
in  the  submodel. 


As  stated  previously,  the  stock  of  personnel  is  characterized  in 
the  aggregate  submodel  as  a  three-dimensional  array  called  the  inven¬ 
tory,  At  the  scart  of  each  submodel  cycle,  the  inventory  describes 
the  population  present  at  the  beginning  of  a  simulated  year.  Each 
cell  in  the  array  indicates  the  size  of  the  group  having  the  skill, 
grade,  and  year  group  properties  that  index  the  cell.  A  few  cross- 
sections  of  the  inventory  array  are  illustrated  in  Figure  4.  In  this 
figure,  grades  are  labeled  by  the  codes  1,3,  5,  7,  and  9;  skill  codes 
range  from  1  to  91 ,  where  1  to  51  correspond  to  airmen  categories  and 
52  to  91  comprise  officer  categories;  and  year  group  indices  extend 
from  1  to  30. 

Figure  4  also  depicts  the  five  possible  types  of  flows  into,  out 
of,  and  within  the  inventory.  Flows  1  and  5  constitute  entry  and  exit 
respectively;  while  the  remaining  three  flows  --  promotion,  aging, 
and  cross-training  —  occur  along  the  three  dimensions  of  the  array. 
Entry-level  trainees  ere  accounted  for  separately,  and  .do  not  appear 
in  the  inventory  array  until  their  initial  skill  is  established. 

The  aggregate  submodel  operates  in  two  phases:  the  planning 
phase  and  the  flow  phase.  Thus,  for  each  simulated  year,  a  year  plan 
is  formulated  based  on  the  initial  inventory  and  the  mission  plan  for 
that  year.  Then,  the  year  plan  is  executed  on  the  inventory  to  pro¬ 
duce  the  simulated  personnel  flows  shown  in  Figure  4.  The  resultant 
array  describes  the  inventory  at  the  end  of  the  current  year,  which, 
of  course;  corresponds  to  the  initial  inventory  for  the  next  submodel 
cycle. 

The  first  activity  performed  in  the  planning  phase  in  each  simu¬ 
lated  year  involves  determining,  on  the  basis  of  the  mission  plan  and 
authorization  ceilings  entered  as  inputs  into  the  aggregate  submodel 
for  the  year,  the  overall  goals  that  the  aggregate  planning  phase  is 
to  achieve  with  its  year  plan.  These  goals  —  the  detailed  manpower 
authorizations  —  indicate  the  number  of  personnel,  partitioned  by 
skill  and  grade,  allowed  to  be  in  the  inventory  at  the  end  of  the 
year. 


The  first  step  in  calculating  the  detailed  authorizations  con¬ 
sists  of  determining  the  aggregate  manpower  requirements:  the  amount 
of  manpower  in  each  skill  and  grade  that  could  optimally  be  employed 
at  mission  tasks  solely  on  the  basis  of  workload  and  productivity 
considerations,  regardless  of  the  size  of  the  budget.  These  require¬ 
ments  are  derived  by  applying  a  set  of  manning  standards  to  the  mission 
specifications  contained  in  the  mission  plan. 

The  mission  specification  for  each  base  describes  the  outputs  that 
must  be  produced  at  the  base  to  support  its  mission.  While  the  full 
ISEM  would  encompass  all  Air  Force  programs  and  missions,  only  two 
types  of  primary  missions  and  two  types  of  secondary  missions  are 
included  in  ISEM-P.  The  primary  missions  are  flying  and  training, 
and  the  secondary  missions  are  flying  support  and  base  support. 
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The  output  of  a  flying  mission  is  defined  to  be  some  number  of 
flying  hours  per  month  for  a  particular  kind  of  aircraft.  The  output 
description  designates  the  aircraft,  the  number  of  squadrons  of  that 
aircraft  attached  to  the  base,  and  the  required  flying  hours  per  air¬ 
craft  per  month.  Training  mission  outputs  are  defined  in  terms  of 
students  trained  per  month  for  a  particular  kind  of  student.  The 
amount  of  output  required  depends  on  the  flying  mission  requirements 
and  the  number  of  suitably  skilled  personnel  already  available  for 
the  year.  Hence,  this  amount  is  determined  endogenously  within  the 
submodel.  Flying  support  outputs,  related  to  services  such  as  main¬ 
tenance,  communications,  and  air  traffic  control  applicable  to  all 
flying  missions  attached  to  a  base,  are  defined  in  terms  of  man-hours 
of  service  per  month  that  must  be  furnished  for  all  the  aircraft  at 
the  base.  Finally,  base  support  outputs,  reflecting  services  such  as 
administration,  fire  protection,  and  ground  transportation  that  are 
provided  to  all  the  personnel  at  a  base,  are  computed  as  a  function 
of  the  other  missions  attached  to  the  base  in  the  mission  plan.  A 
detailed  list  of  the  missions  included  in  the  prototype  is  presented 
in  Table  3. 

Manning  standards  are  functions  that  translate  mission  specifi¬ 
cations  into  required  manning  levels  by  skill  and  grade.  There  is  a 
separate  set  of  manning  standards  associated  with  each  ISEM-P  mission. 
For  the  most  part,  the  standards  included  in  the  prototype  have  been 
adapted  from  actual  Air  Force  manpower  standards  applicable  to  the 
various  skills  related  to  the  missions.  Combining  the  mission  speci¬ 
fications  for  each  base  with  the  manning  standards  for  the  specified 
missions  produces  the  manpower  requirements  for  the  base.  Summing 
over  all  bases  then  provides  the  aggregate  manpower  requirements  by 
skill  and  grade. 

The  second  step  in  determining  the  detailed  manpower  authoriza¬ 
tions  involves  imposing  on  the  aggregate  requirements  the  budgetary 
limitations  summarized  in  the  authorization  ceilings.  Whenever  the 
total  airman  or  officer  manpower  requirements  exceed  the  corresponding 
authorization  ceiling,  establishing  detailed  authorizations  entails 
reconciling  the  aggregate  manpower  requirements  with  the  authorized 
end-strength.  To  accomplish  this  reconciliation,  priorities  based  on 
the  relative  importance  of  the  different  types  of  missions  are  employed 
to  award  authorizations  in  excess  of  the  minimum  permissible  manning 
levels  to  the  various  personnel  groups  partitioned  by  skill  and  grade. 
Authorizations  are  then  allocated  to  bases  in  proportion  to  the  rela¬ 
tive  contribution  of  each  base  to  the  aggregate  manpower  requirements. 

The  next  activity  in  the  aggregate  planning  phase  consists  of 
assessing  how  closely  the  inventory  expected  to  exist  at  the  end  of 
the  simulated  year  conforms  to  the  detailed  authorizations.  This 
assessment  is  accomplished  by  applying  the  exogenous  separation  rates 
to  the  initial  inventory  to  compute  anticipated  attrition  and,  hence, 
to  derive  the  inventory  projected  to  evolve  in  the  absence  of  any 
compensatory  AFMPS  actions. 
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ISEM-P  Missions 
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Then,  the  submodel  determines  the  promotions  required  to  counter¬ 
act  the  anticipated  attrition  losses  and  to  adjust  for  any  changes 
introduced  in  the  mission  plan  for  the  current  year  relative  to  the 
plan  for  the  preceding  year.  First,  the  overall  pool  of  personnel 
eligible  for  promotion  in  each  grade  is  computed  by  summing  over  all 
skill  codes  the  projected  inventory  in  all  eligible  year  groups  for 
that  grade.  Next,  the  rate  at  which  eligible  personnel  must  be  pro¬ 
moted  out  of  each  grade  to  accommodate  demands  for  promotions  at  all 
higher  grades  is  derived.  Third,  to  simulate  the  equal  promotion 
opportunity  policy,  the  number  of  personnel  eligible  for  promotion 
in  each  skill  at  each  grade  is  multiplied  by  the  promotion  rate  calcu¬ 
lated  for  that  grade  to  establish  the  aggregate  promotion  plan  for  the 
year.  Finally,  a  promotion  plan  for  each  month  of  the  year  is  created. 
Specifically,  the  exit  distribution  —  the  proportion  of  total  separa¬ 
tions  occurring  in  each  month  —  is  used  to  determine  the  number  of 
promotions  to  be  made  in  the  month.  In  this  manner,  promotions  are 
timed  to  replace  anticipated  attrition  losses  as  they  arise. 

The  last  activity  in  the  planning  phase  is  the  development  of 
training  and  recruiting  plans.  Projected  vacancies  in  Grade  3  must 
be  filled  by  technical  school  graduates.  Technical  school  entrants, 
in  turn,  must  be  supplied  from  the  initial  training  schools:  Basic 
Military  Training  (BMT)  and  Officer  Training  School  (OTS) .  Finally, 

BMT  and  OTS  entrants  must  be  provided  by  recruiting. 

Each  school  in  this  training  sequence  takes  some  amount  of  time 
to  train  its  students.  Therefore,  to  assure  the  delivery  of  graduates 
at  the  times  when  they  are  needed  in  Grade  3,  the  aggregate  submodel 
schedules  students'  entry  into  schools  at  appropriate  times  to  accom¬ 
modate  all  required  training.  Travel  times  between  bases  are  assumed 
to  be  negligible  during  the  planning  phase. 

Because  training  beginning  in  one  year  may  fill  a  promotion  demand 
in  a  subsequent  year,  training  demands  for  periods  beyond  the  current 
simulated  year  must  be  computed  when  establishing  training  plans  for 
that  year.  Therefore,  in  each  simulated  year,  the  aggregate  submodel 
computes  inventory  projections  and  promotion  plans  for  enough  years 
beyond  the  current  year  to  establish  all  current  training  demands. 
Summing  these  demands  over  all  airmen  and  all  officer  skills  generates 
recruiting  requirements  for  each  month  during  the  simulated  year. 

At  the  conclusion  of  the  planning  phase,  the  aggregate  submodel 
initiates  its  flow  phase,  in  which  the  actual  inventory  is  changed 
on  the  basis  of  both  planned  and  unplanned  events.  First,  actual 
attrition  losses  are  deleted  from  the  inventory.  Because  projections 
of  personnel  attrition  are  seldom  perfectly  accurate,  actual  separa¬ 
tions  are  allowed  to  differ  from  expected  losses  by  some  variance 
factor.  This  deviation  between  anticipated  and  realized  attrition 
will  affect  planning  in  subsequent  simulated  years. 
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Next,  the  planned  promotions  in  each  skill  and  grade  are  distrib¬ 
uted  across  year  groups  in  conformance  with  Air  Force  promotion  policy; 
and  the  resultant  detai]  :d  promotion  plan  is  applied  to  the  inventory. 
If,  in  any  skill  and  grade,  some  year  group  contains  fewer  personnel 
than  the  number  indicated  for  promotion,  the  residual  promotions  are 
drawn  from  lower  year  groups. 

After  promotions  have  been  awarded,  the  inventory  is  aged  by  one 
year.  Aging  is  accomplished  by  transferring  the  contents  of  each  cell, 
for  each  skill  and  grade,  to  the  cell  corresponding  to  the  next  higher 
year  group. 

Then,  aggregate  procurement  and  training  flows  are  simulated.  In 
the  aggregate  submodel,  it  is  assumed  that  all  recruiting  demands  will 
be  fulfilled,  all  new  trainees  will  graduate,  and  all  entry  level 
vacancies  will  be  filled  by  the  end  of  each  simulated  year.  Thus,  all 
graduations  from  each  school  are  totalled  for  all  months  and  entered 
in  the  appropriate  skills,  grades,  and  year  groups  in  the  inventory. 

Finally,  Air  Force  personnel  may  be  induced  to  volunteer  to  change 
occupational  specialties.  This  adjustment  often  involves  a  certain 
amount  of  formal  training  to  learn  new  skills.  In  ISEM-P,  only  airmen 
personnel  are  capable  of  lateral  moves  between  skills,  and  all  such 
moves  are  assumed  to  require  cross-training. 

Crosc-training  sources  are  identified  as  skills  having  surpluses 
relative  to  their  authorizations,  while  cross-training  sinks  are  skills 
experiencing  shortages.  Considering  the  sizes  of  all  shortages  and 
surpluses,  the  maximum  portion  of  any  shortage  permitted  to  be  filled 
through  cross-training,  and  the  historical  rate  at  which  personnel 
have  volunteered  for  cross-training,  the  submodel  determines  the 
total  amount  of  cross-training  provided.  After  allocating  this  total 
across  source  skills,  sink  skills,  grades,  and  year  groups,  the  inven¬ 
tory  is  adjusted  to  reflect  the  resultant  cross-training  flows.  In 
ISEM-P,  all  cross-trainees  are  assumed  to  graduate  from  their  appro¬ 
priate  schools  in  the  sixth  month  of  each  simulated  year. 

At  this  juncture,  all  changes  in  the  aggregate  force  structure 
have  been  simulated,  and  the  actual  inventory  at  the  end  of  the  year 
has  been  established.  This  inventory  is  retained  as  the  initial 
inventory  for  the  ensuing  cycle  of  the  aggregate  submodel.  The 
detailed  manpower  authorizations  and  the  month-by-month  promotion, 
training,  recruiting,  and  cross-training  plans  are  transmitted  to 
the  assignment  submodel. 
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3.5  The  Assignment  Submodel 


The  assignment  submodel  deals  primarily  with  the  geographic  dis¬ 
tribution  of  personnel.  It  does  not  deal  directly  with  Air  Force  pro¬ 
grams,  mission  functions,  manpower  standards,  or  authorization  ceilings. 
Rather,  these  considerations  influence  the  submodel's  performance  only 
through  their  embodiment  in  the  detailed  manpower  authorizations  and 
personnel  plans  established  by  the  aggregate  submodel,  and  used  in  the 
assignment  submodel  as  guides  for  operation.  Thus,  the  subset  of  AFMPS 
goals  and  objectives  explicitly  simulated  in  the  assignment  submodel 
consist  of  providing  people 


1. 

Of 

the  right  kind 

2. 

At 

the  right  place 

3. 

At 

the  right  time 

4. 

In 

sufficient  quantity 

5. 

At 

lowest  cost 

Further,  in  this  submodel  the  feasibility  of  achieving  the  operative 
goals  and  objectives  is  explicitly  restricted  by  only  two  sets  of  con¬ 
straints  : 


1.  Policy  directives 

2.  Exogenous  labor  market  forces 

As  stated  previously,  within  the  assignment  submodel  the  "right  kind" 
of  personnel  is  delineated  in  terms  of  skill  and  grade,  the  "right 
place"  relates  to  a  base,  and  the  "right  time"  corresponds  to  a  simu¬ 
lated  month.  Cost  minimization  is  reflected  in  simulated  AFMPS  deci¬ 
sion  rules  that  seek  to  control  both  the  opportunity  cost  associated 
with  personnel  shortages,  and  the  excess  expenditures  arising  from 
personnel  surpluses  and  from  superfluous  movements  of  personnel  among 
bases. 

In  addition  to  the  policy  directives  embodied  in  the  authoriza¬ 
tions  and  plans  transmitted  from  the  aggregate  submodel,  four  other 
notable  AFMPS  policies  are  incorporated  in  the  assignment  submodel. 
Rotation  policy  establishes  restrictions  on  the  maximum  permissible 
length  of  time  personnel  may  serve  at  overseas  bases.  In  addition, 
time-on-station  policy  specifies  the  minimum  allowable  tour  length 
for  personnel  residing  at  CONUS  bases.  Third,  in  each  skill  and  grade 
experiencing  an  overall  shortage  or  surplus  of  trained  personnel, 
world-wide  manning  level  policy  governs  the  sharing  of  that  surplus 
or  shortage  among  bases.  Finally,  inter-base  transfer  policy  defines 
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the  order  in  which  different  categories  of  personnel  are  selected  for 
assignment  to  CONUS  and  overseas  bases.  The  simulated  decision  rules 
included  in  the  assignment  submodel  contain  representations  of  all 
four  of  these  policy  directives. 

In  this  submodel,  as  stated  previously,  the  population  of  per¬ 
sonnel  at  each  base  is  described  by  a  two-dimensional  array  called  the 
base  supply.  Each  cell  in  the  array  indicates  for  that  base  the  size 
of  the  group  possessing  the  skill  and  grade  characteristics  that  index 
the  cell.  Personnel  in  training  are  accounted  for  in  the  enrollment 
of  the  school  they  are  attending.  Schools  are  located  at  particular 
bases,  but  their  enrollments  are  not  included  in  the  base  supplies  of 
those  bases. 

The  purpose  of  the  assignment  submodel  is  to  simulate  the  decision 
procedures  that  produce  the  assignment  orders  that  cause  personnel  to 
be  transferred  between  bases.  In  most  instances,  inter-base  transfer 
decisions  are  based  on  deviations  that  arise  between  base  supplies  and 
the  authorizations  at  the  bases.  Each  ISEM-P  base  has  an  authorization, 
determined  by  the  aggregate  submodel  during  its  planning  phase,  that 
specifies  the  desired  number  of  personnel  in  each  skill  and  grade  that 
should  be  present  at  the  base  at  the  end  of  each  simulated  year. 

Deviations  between  base  supplies  and  authorizations  can  occur  in 
the  prototype  for  several  reasons.  First,  a  portion  of  the  separations 
computed  for  a  year  are  deleted  from  base  supplies  in  each  month. 

Since  personnel  entering  and  leaving  the  Air  Force  actually  enter  and 
leave  at  specific  bases,  these  personnel  flows  are  treated  as  assign¬ 
ments  in  ISEM-P. 

Second,  assignments  of  cross-trainees  to  schools  affect  base 
supplies  as  personnel  are  transferred  from  supplies  to  school  enroll¬ 
ments.  Assignments  of  students  to  schools  are  based  on  the  school 
entry  schedules  developed  by  the  aggregate  submodel. 

Third,  authorizations  may  change,  either  because  the  mission 
plan  or  authorization  ceilings  have  changed,  or  because  of  special 
assignment  instructions  that  are  introduced  exogenously  as  represen¬ 
tations  of  certain  extraordinary  assignment  sequences,  such  as  those 
involved  in  closing  a  base.  Special  assignment  instructions  might 
specify,  for  example,  that  particular  inter-base  transfers,  changes 
in  authorizations,  or  modifications  of  required  tour  lengths  should 
be  performed  in  particular  months.  In  the  absence  of  such  instruc¬ 
tions,  base  authorizations  for  each  month  in  a  simulated  year  are 
the  same  as  the  authorization  for  the  end  of  the  year. 

Finally,  some  bases  represented  in  the  prototype  have  restric¬ 
tions  on  the  maximum  length  of  time  that  personnel  may  serve  there. 
Consequently,  in  each  month  the  portions  of  the  corresponding  base 
supplies  that  have  reached  these  limits  must  be  rotated  to  other 
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locations.  In  ISEH-P,  only  the  four  overseas  bases  are  assumed  to 
have  maximum  tour  length  restrictions. 

To  eliminate  deviations  of  base  supplies  from  authorizations 
arising  from  any  of  these  sources,  the  assignment  submodel  produces 
appropriate  assignment  orders  and  then  executes  the  orders  on  the 
actual  pool  of  personnel.  Execution  of  an  assignment  order  effects 
the  flow  of  a  group  of  personnel  through  a  school  or  from  one  base 
to  another. 

At  any  instant  during  the  operation  of  the  assignment  submodel, 
any  personnel  not  included  in  base  supplies  are  either  in  a  travel 
pipe  or  a  training  pipe.  A  simplified  depiction  of  the  travel  pipe 
network  is  presented  in  Figure  5.  Personnel  flow  channels  between 
bases  are  represented  as  uni-directional  travel  pipes  in  the  prototype 
and  are  depicted  as  arrows  in  the  figure.  Travel  pipes  are  the  means 
by  which  personnel  are  transferred  between  bases.  Thus,  essentially, 
each  travel  pipe  connects  one  base  to  another. 

Each  pipe  has  an  associated  travel  time  and  capacity  that  governs 
its  sustainable  flow.  Travel  times  are  measured  in  days.  Consequently, 
transferred  personnel  normally  arrive  at  their  destinations  only  a 
small  fraction  of  a  month  after  they  enter  a  pipe.  Travel  pipes  are 
used  to  account  for  the  effects  of  travel  delays  on  base  supplies. 

The  CONUS  bases  are  completely  interconnected  by  travel  pipes. 
However,  to  reach  an  overseas  base,  a  group  must  flow  through  the 
appropriate  Aerial  Port  of  Embarkation  (APOE)  base.  If  the  group's 
trip  does  not  originate  at  an  APOE,  the  trip  consists  of  two  legs, 
one  to  reach  the  APOE  and  one  to  continue  overseas.  Schematic 
diagrams  of  typical  CONUS  and  overseas  travel  pipe  flows  appear  in 
the  upper  portion  of  Figure  6. 

Training  pipes  are  similar  to  travel  pipes,  except  that  entry  to 
and  exit  from  any  training  pipe  occur  at  the  same  base.  For  conve¬ 
nience  in  computing  manpower  requirements,  it  has  been  assumed  in  the 
prototype  that  initial  BMT  or  OTS  training.  Technical  School  Training 
(TST) ,  and  Undergraduate  Pilot  Training  (UPT)  are  performed  at  sepa¬ 
rate  CONUS  bases,  with  one  base  conducting  each  type  of  training. 

Thus,  the  training  pipes  are  located  at  particular  bases,  and  repre¬ 
sent  Air  Force  training  facilities.  Moreover,  the  training  bases  are 
distinct  from  the  operations  bases  that  perform  the  flying  missions. 

As  a  direct  consequence  of  this  structure,  in  ISEM-P  new  personnel 
enter  the  Air  Force  at  the  initial  training  base,  proceed  to  the  TST 
base  or  UPT  base  as  appropriate,  and  then  are  assigned  to  duty  at  an 
overseas  or  CONUS  base.  Schematic  diagrams  of  this  flow  and  of  a 
typical  cross-training  flow  are  presented  in  the  lower  portion  of 
Figure  6. 


Each  training  pipe  is  characterized  by  a  purpose,  a  capacity,  and 
a  training  time.  The  purpose  specifies  the  consequence  of  graduating 
from  the  school:  the  acquisition  of  a  new  skill.  There  are  separate 
training  pipes  for  most  of  the  skills  in  the  prototype.  Further, 
there  are  two  additional  training  pipes  for  personnel  attending  BMT 
and  OTS. 

The  capacity  indicated  for  a  training  pipe  expresses  the  maximum 
enrollment  per  instructor  permitted  at  the  school  at  any  one  time. 

The  number  of  instructors  attached  to  each  school  is  determined  endog¬ 
enously  within  the  prototype.  Hence,  the  total  capacity  of  each  train¬ 
ing  pipe  is  also  derived  endogenously  within  ISEM-P. 

The  training  time  is  the  duration  of  the  course  taught  at  the 
school,  and  is  measured  in  months.  In  skills  for  which,  in  reality, 
there  is  no  formal  technical  school  training  program,  direct  duty 
assignments  occur.  In  the  prototype,  the  training  time  for  each  of 
these  skills  is  equated  to  zero.  In  effect,  duty  assignments  for 
personnel  in  these  skills  are  made  from  null  schools  as  soon  as 
trainees  arrive  there  from  the  initial  training  base.  Thus,  opera¬ 
tionally,  training  pipes  are  used  to  account  for  the  time  required 
to  train  personnel  to  perform  mission  functions. 

The  purpose  of  each  type  of  personnel  flow  represented  in  the 
assignment  submodel  is  summarized  in  Figure  7.  Several  additional 
simplifying  assumptions  embodied  in  the  prototype  are  revealed  in  thic 
figure.  In  particular,  it  is  assumed  that  only  personnel  at  CONUS 
bases  volunteer  for  cross-training,  and  that  all  separations  occur  at 
CONUS  bases.  In  addition,  the  personnel  flow  labelled  overseas 
reassignment  can  be  generated  only  by  special  assignment  instructions. 
In  the  absence  of  such  instructions,  the  only  transfers  out  of  overseas 
bases  consist  of  rotations  at  the  completion  of  single  tours  of  duty. 

Like  the  aggregate  submodel,  the  assignment  submodel  operates  in 
both  a  planning  phase  and  a  flow  phase.  In  each  simulated  month,  the 
planning  phase  creates  assignment  orders  based  on  its  projection  of 
base  supplies  for  the  horizon  period  nine  months  in  the  future.  The 
flow  phase  then  executes  the  assignment  orders  established  9  months 
earlier  for  the  current  month. 

The  first  activity  performed  in  the  planning  phase  in  each  month 
consists  of  entering  into  the  submodel  any  special  assignment  instruc¬ 
tions  specified  exogenously  for  the  month.  Then,  in  conformance  with 
the  instructions,  assignment  orders  are  produced  for  all  mandated 
transfers;  and  all  stipulated  changes  in  authorizations  and  in  required 
tour  lengths  are  implemented  in  the  corresponding  data  structures  and 
simulated  decision  rules. 


Figure  7.  Assignment  submodel  stocks  and  flows. 


Next,  starting  with  the  projection  developed  in  the  preceding 
simulated  month  forecasting  base  supplies  at  the  beginning  of  the 
horizon  period,  the  assignment  submodel  extrapolates  a  new  projection 
reflecting  the  changes  in  base  supplies  over  which  assignment  planners 
have  little  control:  separations,  promotions,  volunteers  for  cross¬ 
training,  and  the  predicted  rotation  of  personnel  who  have  completed 
overseas  tours.  First,  the  separations  expected  to  occur  in  each 
skill  and  grade  during  the  horizon  period  are  computed  by  applying 
the  factor  for  that  month  from  the  exit  distribution  to  the  separa¬ 
tions  predicted  for  the  simulated  year  by  the  aggregate  submodel. 

The  resultant  forecasts  are  then  allocated  to  individual  bases  in 
proportion  to  the  projected  population  in  each  skill  and  grade  at 
each  base  for  the  horizon  period. 

Next,  the  expected  promotions  in  each  skill  and  grade  are  esti¬ 
mated  for  each  base.  Specifically,  the  monthly  promotion  plan  devel¬ 
oped  in  the  aggregate  submodel  is  distributed  among  bases,  as  with 
separations,  in  proportion  to  the  projected  populations  at  the  bases. 

Third,  the  personnel  predicted  to  volunteer  for  cross-training 
are  scheduled  for  entry  into  technical  schools.  The  training  plans 
formulated  in  the  aggregate  submodel  are  examined  to  determine  the 
cross-training  assignments  scheduled  for  each  training  school  in  the 
horizon  period.  Then,  among  the  personnel  groups  predicted  to  expe¬ 
rience  surpluses,  the  submodel  selects  the  particular  skills  and 
grades  fr^m  which  the  cross-trainees  will  be  obtained.  In  each  of 
these  skills  and  grades,  cross-trainees  are  withdrawn  from  CONUS 
bases  in  proportion  to  their  base  supplies. 

Finally,  personnel  expected  to  rotate  from  overseas  bases  are 
deleted  from  projected  overseas  base  supplies.  The  expected  amount 
of  rotation  in  the  horizon  period  is  estimated  on  the  basis  of  dis¬ 
tributions  of  the  proportions  of  base  supplies  scheduled  to  complete 
overseas  tours  in  each  period.  Since  different  bases  have  different 
maximum  permissible  tour  lengths,  a  separate  distribution  is  maintained 
in  the  prototype  for  each  specified  tour  length.  The  resultant  rota¬ 
tion  forecast  is  added  to  a  pool  of  personnel  —  partitioned  by  skill, 
grade,  base,  and  month  of  rotation  --  who  are  expected  to  return  from 
overseas  and,  hence,  require  new  CONUS  assignments. 

After  forecasting  the  base  supplies  anticipated  in  the  absence 
of  any  discretionary  action,  the  assignment  submodel  proceeds  to 
simulate  the  major  decisions  routinely  made  by  the  AFMPS  in  allocating 
personnel  to  bases.  The  sequence  of  actions  taken  by  the  submodel  is 
Intended  to  correspond  to  the  order  in  which  decisions  are  actually 
made  over  time  as  the  AFMPS  plans  personnel  assignments  for  a  partic¬ 
ular  month.  In  ISEM-P,  assignment  orders  are  developed  independently 
for  each  personnel  group  differentiated  by  skill  and  grade. 
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First,  to  compensate  for  any  overall  personnel  surplus  or  short¬ 
age,  the  total  manpower  authorization  for  a  skill  and  grade  is  adjusted 
for  the  world-wide  manning  level  to  obtain  the  entitlement  for  that 
personnel  group.  Specifically,  if  an  overall  shortage  is  anticipated, 
each  base  authorization  is  multiplied  by  the  ratio  of  the  total  pro¬ 
jected  Air  Force  population  to  the  total  authorization  in  that  skill 
and  grade  to  determine  the  base  entitlement.  Conversely,  if  an 
overall  surplus  is  forecast,  the  entitlement  of  each  overseas  base 
is  set  equal  to  its  authorization,  and  each  CONUS  base  authorization 
is  multiplied  by  the  ratio  of  the  remaining  unappropriated  projected 
Air  Force  population  to  the  total  CONUS  authorization  for  each  skill 
and  grade  to  derive  the  entitlements  for  the  CONUS  bases.  This  pro¬ 
cess  ensures  that  overseas  bases  are  never  overstaffed  in  any  skill 
or  grade. 

Next,  the  base  supply  projections  extrapolated  earlier  are  sub¬ 
tracted  from  the  corresponding  base  entitlements  to  compute  the  effec¬ 
tive  demands  for  personnel.  Each  effective  demand  indicates  the  number 
of  additional  personnel  in  some  skill  and  grade  required  to  fulfill  an 
entitlement  at  some  base. 

Finally,  assignment  orders  are  created  to  satisfy  the  effective 
demands.  Four  distinct  sources  of  personnel  supplies  are  considered 
sequentially  by  the  submodel. 

First,  effective  demands  at  overseas  bases  are  filled  from  pro¬ 
jected  CONUS  base  supplies.  Personnel  eligible  for  overseas  tours 
must  have  resided  in  the  CONUS  longer  than  the  minimum  permissible 
time,  normally  24  months.  In  each  skill  and  grade,  personnel  are 
selected  from  CONUS  bases  in  proportion  to  the  eligible  populations 
at  the  bases.  Effective  demands  in  excess  of  the  total  number  of 
eligible  personnel  are  not  filled  at  this  time. 

Then,  to  the  extent  possible,  assignment  orders  are  established 
for  personnel  expected  to  return  from  overseas  tours.  Specifically, 
effective  demands  at  CONUS  bases  are  filled  from  the  previously  dis¬ 
cussed  rotation  pool  containing  the  number  of  personnel  in  each  skill 
and  grade  available  for  reassignment  from  each  overseas  base  in  each 
month  between  the  current  month  and  the  horizon  period.  Personnel 
available  in  earlier  months  receive  assignment  orders  before  personnel 
available  in  later  periods. 

Next,  projected  future  training  school  graduates  are  allocated  to 
the  bases.  Records  for  such  graduates  are  maintained  in  technical 
training  pools,  indicating  the  number  of  trainees  currently  in  tech¬ 
nical  schools  who  have  not  yet  received  the  assignments  they  will  / 

perform  after  graduation.  Effective  demands  at  overseas  bases  have 
priority  over  effective  demands  at  CONUS  bases  when  graduates  are 
distributed  from  these  pools.  As  assignment  orders  are  generated, 
they  are  filed  in  the  queues  of  dispositions  for  the  associated  schools. 
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As  trainees  graduate,  the  dispositions  are  honored  in  the  order  in 
which  they  were  filed.  Thus,  technical  school  graduates  might  not 
augment  actual  base  supplies  in  the  month  for  which  they  were  added 
to  projected  base  supplies. 

Finally,  if  any  unfilled  CONUS  demands  remain,  the  submodel 
attempts  to  fulfill  the  demands  from  CONUS  bases.  To  be  an  accept¬ 
able  source  for  a  transfer  of  personnel  between  CONUS  bases,  a  base 
must  have  (a)  a  surplus  of  personnel  in  the  demanded  grade;  (b)  a 
surplus  of  personnel  in  the  demanded  skill,  regardless  of  grade;  and 
(c)  personnel  eligible  for  reassignment  through  their  residence  at 
the  base  for  more  than  the  minimum  allowable  time-on-station,  normally 
36  months. 

If  the  total  number  of  eligible  personnel  at  all  bases  exceeds 
the  total  effective  demand,  assignment  orders  are  distributed  among 
bases  in  proportion  to  the  number  of  eligible  personnel  at  each  base. 
If  the  total  supply  is  less  than  the  total  demand,  eligible  personnel 
are  allocated  in  pro  'ortion  to  the  effective  demand  at  each  base.  If 
the  two  totals  are  equal,  all  demands  are  fulfilled  using  all  eligible 
personnel. 

At  the  conclusion  of  the  planning  phase,  the  assignment  submodel 
initiates  its  flow  phase,  in  which  the  assignment  orders  and  personnel 
dispositions  created  in  the  planning  phase  are  implemented.  In  this 
phase,  the  submodel  simulates  the  movements  of  personnel  ti.  ough 
travel  and  school  pipes,  and  the  consequent  adjustments  in  uase 
supplies,  that  have  been  prescribed  during  the  planning  phase. 

Before  any  established  assignment  orders  are  executed,  however, 
two  preliminary  activities  are  performed.  First,  if  actual  separa¬ 
tions  differ  from  expectations,  all  projections  made  on  the  basis  of 
the  expected  separations  are  revised  to  conform  to  reality.  Thus, 
the  submodel  investigates  whether  any  personnel  scheduled  to  rotate 
from  overseas  bases  during  the  current  simulated  month  have  not  yet 
been  reassigned  to  duty  at  CONUS  bases.  Whenever  this  situation 
prevails,  an  attempt  is  made  to  find  current  personnel  shortages  in 
appropriate  skills  and  grades  in  the  CONUS.  If  any  such  shortages 
are  found,  uncommitted  personnel  are  assigned  to  the  associated  CONUS 
bases  in  proportion  to  the  size  of  the  shortage  at  each  base.  Then, 
in  accord  with  the  world-wide  manning  level  policy,  if  any  personnel 
remain  unassigned  after  all  applicable  CONUS  shortages  have  been 
eliminated,  the  residual  personnel  are  allocated  to  CONUS  bases  as 
surpluses  in  proportion  to  the  authorization  at  each  base. 

After  completing  these  preparatory  actions,  all  assignment  orders 
are  implemented,  and  all  resultant  inter-base  flows  are  initiated. 
Promotions  are  awarded  as  planned,  and  base  supplies  are  adjusted 
accordingly.  Personnel  groups  transferring  between  bases  are  entered 
into  the  appropriate  travel  pipes.  New  recruits  for  the  current  month 
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are  entered  into  initial  training  school  pipes,  and  are  classified 
into  skills  in  conformance  with  the  technical  school  entry  schedules 
established  for  the  month  when  they  will  graduate  from  initial  train¬ 
ing.  The  classification  is  then  manifested  by  creating  dispositions 
at  the  initial  training  schools  for  the  appropriate  number  of  per¬ 
sonnel  in  each  skill.  These  dispositions  subsequently  direct  the 
initial  training  school  graduates  to  the  technical  schools  providing 
the  designated  skills,  just  as  technical  school  dispositions  control 
the  assignment  of  technical  school  graduates  to  bases. 

The  school  dispositions  established  for  the  current  month  are 
implemented;  and  the  corresponding  personnel  groups  are  entered  into 
appropriate  travel  pipes.  Whenever  no  disposition  has  been  established 
for  a  group  of  technical  school  graduates,  they  are  allocated  among 
bases  using  essentially  the  same  procedure  employed  to  create  assign¬ 
ment  orders  for  uncommitted  personnel  returning  to  the  CONUS  from 
overseas  bases.  However,  in  this  case,  personnel  may  be  distributed 
among  all  bases,  and  not  just  among  the  CONUS  bases.  Excess  initial 
training  school  graduates  are  assigned  randomly  to  available  technical 
training  schools. 

Finally,  when  groups  of  personnel  emerge  from  travel  pipes  at 
their  destination  bases,  they  are  either  added  appropriately  into  base 
supplies,  or  entered  into  the  designated  schools  at  the  bases.  Upon 
completion  of  these  operations,  all  personnel  flows  through  schools, 
between  and  within  bases,  and  into  and  '■'ut  of  the  Air  Force  itself 
have  been  simulated;  the  actual  base  supplies  at  the  end  of  the 
current  month  have  been  established;  and  the  projected  base  supplies 
at  the  end  of  the  horizon  period  have  been  estimated.  These  actual 
and  projected  base  supplies  are  retained  as  initial  descriptions  of 
the  stock  of  personnel  for  the  ensuing  cycle  of  the  assignment  sub¬ 
model  , 

There  are  12  monthly  cycles  of  the  assignment  submodel  for  each 
yearly  cycle  of  the  aggregate  submodel.  The  entire  process  is  iterated 
through  the  total  number  of  simulated  years,  typically  five,  for  which 
input  data  are  provided  to  the  prototype. 
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4.0 


CONCEPTUAL  STRUCTURE  OF 
THE  SENSITIVITY  ANALYSIS 


The  detailed  discussion  of  the  design  and  operation  of  ISEM-P 
presented  in  the  preceding  section  clearly  indicates  that  the  descrip¬ 
tions  of  planned  and  realized  personnel  movements  and  force  structures 
developed  by  the  prototype  are  ultimately  based  on,  and  hence  are  very 
likely  to  be  affected  by,  the  large  number  and  wide  variety  of  assump¬ 
tions  contained  in  the  model.  Specifically,  the  outputs  produced  by 
the  prototype  are  undoubtedly  influenced,  to  a  greater  or  lesser 
extent,  by  the  assumptions  underlying  such  attributes  of  ISEM-P  as: 

1.  The  form  and  content  of  the  prototype's  simulations 
of  Air  Force  policy  directives  and  AFMPS  decision 
rules . 

2.  The  nature  of  the  prototype's  characterizations  of 
conditions  affecting,  yet  largely  exogenous  to,  the 
AFMPS. 

3.  The  initial  conditions  relative  to  which  the  proto¬ 
type  initiates  its  simulation  of  AFMPS  operations. 

4.  The  scale  of  aggregation  and  degree  of  detail 
embodied  in  the  prototype's  representation  of  the 
structure  of  the  Air  Force  and  its  stock  of  personnel. 

In  recognition  of  such  widespread  prospective  sources  of  imprecision 
and  inaccuracy,  it  is  now  appropriate  to  undertake  a  systematic  exam¬ 
ination  of  the  sensitivity  of  the  outputs  produced  by  the  prototype 
to  the  specific  assumptions  explicitly  or  implicitly  incorporated 
within  its  design. 

The  purpose  of  this  study  is,  therefore,  to  perform  a  thorough 
analysis  of  the  changes  observed  in  a  variety  of  measures  or  indi¬ 
cators  of  the  prototype's  performance  that  result  from  methodical 
adjustments  of  the  values  of  particular  parameters  associated  with 
key  model  structure  issues.  It  is  important  to  realize  at  the  outset, 
however,  that  the  sensitivity  analysis  developed  in  this  study  is 
capable  only  of  examining  the  reliability  of  the  prototype's  simula¬ 
tion  of  the  AFMPS,  but  is  unavoidably  inadequate  to  assess  the  accu¬ 
racy  of  the  simulation.  Because  of  the  extreme  disparity  between  the 
scale  of  ISEM-P  and  the  size  of  the  Air  Force,  it  has  been  impossible 
to  develop  sufficiently  analogous  data  to  permit  valid  comparison  of 
the  simulated  performance  of  the  prototype  with  the  actual  behavior 
of  the  AFMPS  for  any  situation.  Consequently,  all  comparisons  made 
in  this  study  consist  of  examinations,  for  identical  operational  situ¬ 
ations,  of  differences  in  the  performance  of  the  prototype  under  sys¬ 
tematically  different  sets  of  parametric  assumptions. 
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Such  contrasts,  regrettably,  provide  no  indication  of  the  realism 
of  the  outputs  generated  by  the  prototype,  for  any  set  of  parameter 
values,  as  descriptions  of  the  behavior  of  the  AFMPS  in  any  situation. 
The  comparisons  do,  however,  supply  clear  evidence  of  the  relative 
responsiveness  of  ISEM-P  to  adjustments  in  the  values  of  its  various 
structural  parameters.  Thus,  they  indicate  the  components  of  the  model 
in  which  it  is  empirically  important  to  establish  accurate  representa¬ 
tions  of  AFMPS  decision  rules  and  operating  conditions,  and,  conversely, 
the  elements  for  which,  over  a  reasonably  broad  range,  the  specific 
values  assigned  to  parameters  have  relatively  little  impact  on  the 
performance  of  the  prototype. 


4.1  The  Issues  Examined 


Overall,  assessments  of  the  relative  sensitivity  of  the  perform¬ 
ance  of  ISEM-P  to  changes  in  the  values  of  11  distinct  sets  of  param¬ 
eters  have  been  conducted.  Within  most  of  these  sets,  multiple  changes 
in  parameter  values,  frequently  for  more  than  one  parameter,  have  been 
examined.  Moreover,  as  indicated  previously,  the  changes  studied  can 
be  meaningfully  grouped  into  four  basic  categories. 

Thus,  within  the  context  of  this  categorical  framework,  the  spe¬ 
cific  model  structure  issues  investigated  in  this  study  consist  of: 

1.  Analyses  of  the  form  and  concent  of  ISEM-P' s  represen¬ 
tations  of  Air  Force  policy  directives  and  AFMPS  deci¬ 
sion  rules,  where  the  changes  in  parameter  values 
examined  are: 

-  Increases  and  decreases  of  20  percent  in  six 
principal  mission  specifications  or  manning 
standards,  including: 

.  Standard  flying  hours  —  the  amount  of  flight 
time  that  a  squadron  of  aircraft  attached  to 
a  particular  mission  is  expected  to  produce 
during  a  month.  This  parameter  directly 
influences  the  calculations  of  manpower 
requirements  for  aviators. 

.  The  flight  plan  coefficient  —  the  number  of 
flight  plans  that  a  squadron  is  expected  to 
generate  per  hour  of  flight  time  produced. 

This  attribute  directly  affects  the  deter-  / 

mination  of  manpower  requirements  for  air 
operations  personnel. 
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.  The  munition  load  factor  —  the  quantity  of 
munitions  maintained  in  inventory  as  a  pro¬ 
portion  of  the  standard  munition  load  of  an 
aircraft  attached  to  a  particular  mission. 

This  property  is  a  prime  determinant  of  the 
manpower  requirements  for  munitions/weapons 
control  systems  personnel. 

.  The  maintenance  manpower  factor  —  the  por¬ 
tion  of  a  standard  work  day  during  which 
maintenance  personnel  normally  are  directly 
involved  in  productive  maintenance  activity. 
This  parameter  contributes  directly  to  the 
computation  of  manpower  requirements  for 
maintenance  personnel. 

.  The  work  load  factor  —  the  amount  of  elec¬ 
tronic  communications  repair  activity  required 
at  a  base  in  relation  to  the  total  quantity 
of  aircraft  and  other  equipment  attached  to 
the  base.  This  coefficient  is  a  principal 
element  in  the  calculation  of  manpower 
requirements  for  communications /weather 
personnel. 

.  Base  support  coefficients  —  factors  express¬ 
ing  the  manpower  requirements  for  various 
types  of  base  support  personnel  as  percentages 
of  the  total  population  of  a  base. 

Reductions  of  the  minimum  permissible  time-in-CONUS 
prior  to  reassignment  overseas,  and  the  minimum 
allowable  time-on-station  prior  to  reassignment 
within  the  CONUS,  from  their  basic  values  of  24 
months  and  36  months,  respectively.  Specifically: 

.  Reductions  of  both  requirements  by  6  months, 
to  18  months  for  time-in-CONUS  and  30  months 
for  time-on-station. 

.  Reductions  of  both  requirements  by  12  months, 
to  12  months  for  time-in-CONUS  and  24  months 
for  time-on-station. 

Modifications  of  the  length  of  the  planning  horizon 
employed  in  the  assignment  submodel  from  its  normal 
value  of  9  months,  including: 

.  A  2-month  extension  of  the  assignment  planning 
horizon  to  1 1  months. 
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.  A  2-month  compression  of  the  assignment  plan¬ 
ning  horizon  to  7  months. 

2.  Examinations  of  the  nature  of  ISEM-P's  characterizations 
of  essentially  exogenous  conditions  affecting  the  AFMPS, 
where  the  parameter  adjustments  investigated  are: 

Changes  in  personnel  retention  rates  —  the  rates 
at  which  personnel  choose  not  to  separate  from 
the  Air  Force  —  from  their  historically  observed 
values  in  each  year  group  and  grade.  In  particular: 

.  Increases  in  the  retention  rates  of  all  per¬ 
sonnel  groups  by  20  percent,  or  to  the  maximum 
feasible  value  of  1.0,  whichever  is  smaller. 

.  Decreases  of  the  retention  rates  of  all  per¬ 
sonnel  groups  by  20  percent. 

-  Increases  in  the  amount  of  time  required  for  travel 
between  bases.  Specifically: 

.  Extension  of  the  travel  times  associated  with 
all  travel  pipes  by  a  factor  of  two. 

.  Extension  of  the  travel  times  associated  with 
all  travel  pipes  by  a  factor  of  three. 

3.  Investigations  of  the  initial  conditions  defining  the 
composition  of  the  prototype's  stock  of  personnel  at 
the  beginning  of  a  simulation,  where  the  changes  ana¬ 
lyzed  include: 

-  Replacement  of  an  initial  personnel  distribution 
partitioned  by  year  group  that  has  been  derived 
from  historical  data,  with  an  equivalent  distri¬ 
bution  reflecting  the  Air  Force's  established 
force  structure  objectives. 

-  Replacement  of  an  initial  personnel  distribution 
partitioned  by  grade  that  has  been  derived  from 
historical  data,  with  an  equivalent  distribution 
developed  from  the  Air  Force's  adopted  force 
structure  objectives. 

4.  Inquiries  into  the  scale  of  aggregation  and  degree  of 
detail  contained  in  ISEM-P's  representations  of  the 
organizational  structure  and  personnel  stocks,  where 
the  modifications  studied  are: 
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Reductions  of  the  number  of  bases  in  the  proto¬ 
type  by  deleting  the  representation  of  different 
individual  bases  in  separate  simulations.  The 
specific  modifications  examined  include: 

.  Deletion  of  Base  6,  a  TAC  operations  base 

in  the  CONUS.  Since  this  base  accommodates 
precisely  the  same  missions  as  Base  13,  this 
analysis  also  comprises  an  investigation  of 
the  deletion  of  Base  13. 

.  Deletion  of  Base  7,  a  SAC  operations  base 
in  the  CONUS.  Because  of  their  identical 
missions,  this  analysis  also  constitutes 
an  examination  of  the  deletion  of  Base  8 
or  Base  9. 

.  Deletion  of  Base  12,  a  TAC  operations  base 
in  the  CONUS. 

.  Deletion  of  Base  14,  an  operations  base  in 
Europe. 

.  Deletion  of  Base  15,  the  second  operations 
base  in  Europe. 

.  Deletion  of  Base  16,  an  operations  base  in 
the  Pacific. 

.  Deletion  of  Base  17,  the  second  operations 
base  in  the  Pacific. 

The  three  ATC  bases  —  Base  1,  Base  2,  and  Base  3 
—  have  not  been  deleted  because  their  distinct 
training  missions  make  each  base  a  unique  source 
of  supply  for  personnel  in  different  skills. 
Similarly,  Base  10  has  not  been  deleted  because 
it  is  the  only  CONUS  base  accommodating  a  flying 
mission  also  attached  to  overseas  Bases  15  and  16. 
Without  Base  10,  rotation  of  personnel  would  be 
impossible  for  several  skills.  Finally,  the  two 
APOE  bases  —  Base  4  and  Base  5  —  have  not  been 
deleted  because  of  their  crucial  roles  in  the 
prototype's  grid  of  travel  pipes. 

Increases  in  the  scale  of  the  organizational  units 
represented  in  the  prototype  by  selectively  combin 
ing  the  mission  specifications  for  different  bases 
The  base  combinations  analyzed  include: 


.  Aggregations  of  the  two  sets  of  identical  bases 
in  the  CONUS  —  TAC  Bases  6  and  13,  and  SAC 
Bases  7,  8,  and  9  —  to  produce  representations 
of  only  14  bases  in  the  prototype. 

.  Consolidation  of  CONUS  bases  in  the  same  major 
commands  --  MAC  Bases  4  and  10;  TAC  Bases  6, 

11,  12,  and  13;  and  SAC  Bases  7,  8,  and  9  — 
into  integrated  organizational  units,  creating 
representations  of  just  11  bases  in  the  proto¬ 
type. 

.  Combination  of  Bases  4  through  13  —  all  CONUS 
bases  except  the  three  ATC  bases  —  resulting 
in  representations  of  only  eight  bases  in 
ISEM-P. 

Decreases  in  the  degree  of  detail  embodied  in  the 
skill  categories  characterized  in  ISEM-P  by  selec¬ 
tively  combining  the  skill  classifications  listed 
in  Table  1.  Three  different  consolidations  of 
skill  classifications  have  been  performed,  result¬ 
ing  in: 

.  Reductions  in  the  number  of  airman  skill  cate¬ 
gories  to  36,  and  the  number  of  officer  skill 
categories  to  25. 

.  Further  decreases  in  the  numbers  of  airman 
and  officer  skill  categories  to  29  and  19 
respectively. 

.  Ultimate  reductions  in  the  numbers  of  skill 
categories  to  19  for  airmen  and  12  for 
officers . 

The  precise  compositions  of  these  aggregations  of 
skill  classifications  are  presented  in  Table  4. 

-  Reduction  of  the  time  period  for  which  a  simulation 
is  conducted  from  5  years  to  3  years. 

Thus,  a  total  of  36  different  adaptations  of  the  values  of  structural 
parameters  of  ISEM-P  have  been  undertaken  for  the  sensitivity  analyses 
conducted  in  this  study.  These  adaptations  are  summarized  briefly  in 
Table  5. 
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Table  4:  Consolidated  Skill  Categories 


Table  5:  Issues  Examined  in  the  Sensitivity  Analysis 
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4.2  Basic  Analytic  Approach 


To  analyze  the  sensitivity  of  the  performance  of  ISEM-P  to  the 
various  changes  in  parameter  values  described  in  the  preceding  section, 
the  outputs  generated  by  the  prototype  for  each  modified  specification 
of  parameter  values  have  been  systematically  compared  to  analogous 
outputs  derived  for  the  initial  specification  of  parameter  values. 

In  addition,  to  assess  the  degree  to  which  the  relative  responsiveness 
of  the  prototype's  performance  to  particular  changes  in  parameter 
values  might  vary  for  simulations  of  different  operating  environments, 
comparisons  have  been  made  within  the  context  of  five  different  base¬ 
line  scenarios  corresponding  to  five  contrasting  operational  situations. 
Thus,  for  virtually  all  of  the  revised  specifications  of  ISEM-P  param¬ 
eter  values,  separate  comparisons  have  been  conducted  for  five  distinct 
baseline  scenarios. 

The  first  baseline  scenario  employed  in  the  sensitivity  analysis 
describes  a  situation  in  which  the  mission  plan  and  authorization  ceil¬ 
ings  are  identical  for  all  years  of  the  simulation.  Moreover,  the 
authorization  ceilings  are  equated  to  the  total  manpower  requirements 
for  airmen  and  for  officers.  Consequently,  this  scenario  corresponds 
to  an  operational  situation  in  which  no  external  stress  is  imposed 
upon  the  AFMPS  throughout  the  time  period  under  consideration. 

In  the  second  baseline  scenario,  ISEM-P  simulates  the  closing 
of  Base  16,  one  of  the  two  PACAF  bases  represented  in  the  prototype. 
During  the  second  year  of  the  simulation,  the  missions  initially 
attached  to  Base  16  are  reassigned  to  Base  17,  the  other  PACAF  base 
included  in  ISEM-P.  Personnel  are  then  transferred  appropriately  to 
achieve  the  relocation  of  the  missions.  Thus,  closing  a  base  primarily 
affects  the  assignment  submodel,  which  must  respond  to  a  geographic 
shift  in  the  placement  of  missions  by  redistributing  base  supplies  to 
conform  to  revised  base  authorizations. 

In  a  real  base  closure  situation,  the  AFMPS  carefully  strives  to 
control  the  timing  of  personnel  reassignments.  To  assure  uninterrupted 
readiness  throughout  the  relocation  interval,  different  categories  of 
personnel  are  transferred  between  bases  in  a  specific  preplanned  order. 
Essentially,  mission  support  personnel  relocate  first;  direct  mission 
personnel,  and  equipment,  follow;  and  base  support  personnel  are  trans¬ 
ferred  last. 

This  pattern  is  simulated  in  the  ISEM-P  base  closure  scenario  by 
reassigning  the  mission  support  personnel  of  Base  16  during  the  first 
3  months  of  the  second  year,  and  then  relocating  the  direct  mission 
personnel  and  the  base  support  personnel  during  the  third  through  the 
fifth  months  of  the  year.  This  sequence  of  activities  is  communicated 
to  the  planning  phase  of  the  assignment  submodel  as  a  series  of  changes 
in  the  authorizations  of  affected  bases.  By  the  sixth  month  of  the 
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second  year,  Base  16  has  effectively  been  closed  since  it  has  neither 
authorizations  nor  supplies  and,  hence,  cannot  be  involved  in  any 
further  assignment  actions. 

The  third  baseline  scenario  corresponds  to  a  situation  in  which 
Air  Force  personnel  budgets  are  repeatedly  reduced.  Specifically, 
beginning  with  initial  authorization  ceilings  equal  to  total  airman 
and  officer  manpower  requirements,  the  ceilings  established  in  the 
prototype  are  successively  decreased  by  2  percent  in  each  subsequent 
year.  Then,  by  applying  the  procedures  contained  in  ISEM-P  for  recon¬ 
ciling  manpower  requirements  with  authorization  ceilings,  the  reduc¬ 
tions  in  authorizations  are  imposed  on  the  base  support  and  mission 
support  skills,  while  the  authorizations  for  the  direct  mission  skills 
are  maintained  at  their  initial  levels.  The  allocation  of  authoriza¬ 
tion  reductions  to  mission  support  and  base  support  skills  is  deter¬ 
mined  on  the  basis  of  minimum  permissible  manning  levels  of  84  percent 
of  manpower  requirements  for  mission  support  skills,  and  57  percent  of 
requirements  for  base  support  skills. 

The  fourth  baseline  scenario  investigates  the  effects  of  a  change 
in  workload  parameters  during  the  course  of  a  simulation.  In  this 
scenario,  the  aircraft  utilization  rate  of  all  B-52  aircraft  is 
reduced  by  20  percent  beginning  in  the  second  year,  and  continuing 
through  the  end  of  the  simulation.  This  parameter  indicates  the 
amount  of  flight  time  actually  produced  by  a  typical  aircraft  in  a 
B-52  squadron  during  one  month.  A  reduction  in  this  rate  induces  a 
decrease  in  manpower  requirements  and,  subsequently,  in  personnel 
authorizations  for  associated  skills,  including  B-52  pilots,  B-52 
navigators,  aerial  gunners,  various  maintenance  skills,  some  mission 
support  skills  such  as  air  operations,  and  all  base  support  skills. 

In  the  final  baseline  scenario,  the  prototype  examines  the  con¬ 
sequences  of  errors  in  forecasts  of  personnel  attrition  for  promotion, 
training,  and  recruitment  planning.  To  perform  this  investigation, 
actual  retention  rates  are  reduced  60  percent  below  projected  reten¬ 
tion  rates  for  three  airman  skills  and  one  officer  skill  in  the  second 
year  of  the  simulation.  In  all  other  years,  and  for  all  other  skills 
in  the  second  year,  actual  separations  are  assumed  to  correspond 
exactly  to  expectations. 

Thus,  in  summary,  the  five  baseline  scenarios  utilized  as  the 
foundations  of  the  sensitivity  analysis  consist  of  constant  authori¬ 
zations,  base  closure,  reduced  authorizations,  reduced  aircraft  utili¬ 
zation,  and  reduced  retention. 
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5.0  SENSITIVITY  ANALYSIS  METHODOLOGY 


Basically,  the  methodology  used  to  analyze  the  sensitivity  of  the 
performance  of  ISEM-P  to  changes  in  the  values  of  its  structural  param 
eters  consists  of  systematically  comparing  the  outputs  produced  by  the 
prototype  with  its  initial  specification  of  parameter  values  to  the 
outputs  generated  with  the  modified  sets  of  parameter  values  corre¬ 
sponding  to  the  36  sensitivity  issues,  in  the  operational  situations 
described  by  the  five  baseline  scenarios.  To  implement  this  method¬ 
ology,  it  is  first  necessary  to  formulate  suitable  measures  of  the 
prototype's  performance;  i.e.,  measures  such  that  noticeable  differ¬ 
ences  in  their  magnitudes  derived  for  different  specifications  of 
parameter  values  indicate  notable  disparities  in  important  aspects  of 
the  prototype's  performance.  Then,  procedures  must  be  established  for 
methodically  comparing  the  magnitudes  attained  by  the  measures  in  anal 
ogous  simulations  embodying  systematically  different  specifications  of 
parameter  values,  to  obtain  an  evaluation  of  the  sensitivity  of  ISEM-P 
to  the  associated  changes  in  parameter  values. 


5.1  ISEM-P  Performance  Measures 


Because  ISEM-P  has  been  designed  to  simulate  the  interactions  of 
numerous  rypes  of  decisions  made  by  the  various  components  of  the 
AFMPS ,  no  single  natural  indicator  exists  to  summarize  all  pertinent 
facets  of  the  prototype's  performance.  Rather,  a  wide  variety  of 
prospective  measures  of  different  salient  aspects  of  ISEM-P's  perform¬ 
ance  are  conceivable. 

Moreover,  because  the  ultimate  use  of  the  ISEM  concept  within  the 
Air  Force  has  not  yet  been  determined,  it  is  currently  impossible  to 
establish  any  defensible  priorities  expressing  the  relative  importance 
of  the  various  possible  disaggregated  performance  measures.  Conse¬ 
quently,  no  single  synthetic  indicator  can  presently  be  formulated  to 
summarize  the  disaggregated  measures. 

Therefore,  five  basic  types  of  performance  measures  have  been 
employed  in  this  study: 

1.  Deviation  measures,  indicating  the  frequency  and  mag¬ 
nitude  of  deviations  between  actual  stocks  of  per¬ 
sonnel  and  manpower  authorizations. 

2.  Mobility  measures,  reflecting  the  volume  of  personnel 
transfers  involved  in  achieving  established  plans. 

3.  Accession/retention  measures,  monitoring  the  inter¬ 
actions  of  the  AFMPS  with  the  private  labor  market. 
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4.  Training  measures,  appraising  the  training  loads 
experienced  by  the  initial  training  schools  and 
the  technical  schools. 

5.  Status  measures,  describing  the  composition  of  the 
stock  of  personnel  at  a  particular  time. 

Each  of  these  types  of  measures  can  be  directly  related  to  some  form 
of  direct  expenditure  or  opportunity  cost  borne  by  the  Air  Force.  The 
deviation  measures  reflect  both  the  excess  expenditures  associated 
with  maintaining  surplus  personnel,  and  the  opportunity  costs  in  terms 
of  impaired  mission  readiness  arising  from  personnel  shortages.  The 
expenses  involved  in  transporting  personnel  between  bases  are  evidenced 
in  the  mobility  measures.  The  accession/retention  measures  monitor 
the  costs  of  labor  turnover;  i.e.,  the  opportunity  costs  of  losing 
skilled  personnel  and  the  outlays  required  to  procure  new  personnel. 

The  training  measures  indicate  the  direct  costs  of  imparting  new  skills 
to  personnel  and  the  opportunity  cost  of,  in  effect,  withholding  per¬ 
sonnel  involved  in  training  from  operational  duty.  Finally,  the  status 
measures  provide  a  basis  for  assessing  the  opportunity  costs  associated 
with  differences  in  the  levels  of  expertise  and  experience  possessed 
by  different  stocks  of  personnel. 

In  addition,  each  "ype  of  measure  has  been  formulated  to  disclose 
a  variety  of  degrees  of  detail  about  the  performance  of  the  prototype. 
The  alternative  degrees  of  detail  correspond  essentially  to  different 
levels  cf  aggregation  of  the  basic  personnel  groups  delineated  in 
ISEM-P.  For  the  deviation  and  mobility  measures,  the  various  degrees 
of  detail  relate  to  aggregations  of  personnel  groups  partitioned  by 
skill,  grade,  and  geographic  location.  Accumulations  of  groups  dif¬ 
ferentiated  by  skill  and  grade  establish  the  degree  of  detail  embodied 
in  the  accession/ retention  measures.  The  detail  included  in  the  train¬ 
ing  measures  creates  distinctions  based  solely  on  differences  in  skill 
codes.  Finally,  in  the  status  measures,  the  degrees  of  detail  refer 
to  aggregations  of  personnel  groups  distinguished  by  grade  and  year 
group  for  both  airmen  and  officers. 

The  specific  degrees  of  detail  examined  for  all  of  the  types  of 
performance  measures  used  in  the  sensitivity  analysis  are  summarized 
in  Figure  8.  Thus,  beginning  at  the  highest  level  of  aggregation, 
the  total  stock  of  personnel  represented  in  ISEM-P  is  first  divided 
on  the  basis  of  skill  codes  into  two  basic  personnel  types:  airmen 
and  officers.  Next,  for  the  deviation,  mobility,  and  accession/ reten¬ 
tion  measures,  each  personnel  type  is  subdivided  into  three  broad 
classes  of  skills:  mission,  mission  support,  and  base  support.  Then, 
for  all  types  of  performance  measures  except  the  status  measures, 
further  disaggregation  is  performed  at  the  level  of  individual  skill 
code?  . 


Figure  8. 


Degrees  of  detail  in  performance  measures. 
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In  the  deviation  and  mobility  measures,  cross-tabulations  are 
provided  on  the  basis  of  geographic  location  for  virtually  all  of  the 
personnel  groupings  described  above.  With  the  mobility  measures,  the 
cross-tabulations  are  based  on  broad  distinctions  between  CONUS  and 
overseas  bases;  while  for  the  deviation  measures,  distinctions  are 
created  among  the  individual  bases. 

A  separate  set  of  cross-tabulations  is  developed,  in  all  measures 
except  the  training  measures,  for  the  different  grades.  Moreover,  in 
the  status  measures,  further  cross-tabulations  are  established  to  dif¬ 
ferentiate  among  year  groups. 

Finally,  for  the  deviation,  mobility,  and  accession/retention 
measures,  all  indicators  are  derived  both  cumulatively  throughout 
each  simulated  year,  and  for  the  last  month  of  each  year.  Conversely, 
for  the  training  and  status  measures,  all  indicators  summarize  each 
year  as  a  whole. 

Since  many  of  the  sensitivity  issues  analyzed  in  this  study, 
such  as  the  base  deletion,  base  consolidation,  and  skill  consolidation 
issues,  involve  changes  in  the  scale  of  ISEM-P,  all  performance  mea¬ 
sures  have  been  designed  in  forms  whose  values  are  independent  of  the 
scale  of  the  prototype.  Thus,  the  performance  measures  are  predom¬ 
inantly  defined  in  terms  of  ratios.  Only  a  small  number  of  measures 
indicate  the  maximum  values  attained  by  certain  variables. 

The  deviation  measures  are  all  ultimately  based  on  the  observed 
differences  between  actual  personnel  stocks  and  detailed  manpower 
authorizations  for  personnel  groups  partitioned  by  skill,  grade,  and 
base.  This  evidence  is  methodically  accumulated  for  the  more  highly 
aggregated  collections  of  personnel  discussed  above  to  develop  indi¬ 
cators  of  the  overall  success  of  the  simulated  AFMPS  in  fulfilling 
its  manpower  authorizations.  Seven  different  methods  of  accumulating 
the  individual  deviations  from  authorizations  for  all  basic  personnel 
groups  within  each  of  the  more  highly  aggregated  personnel  collections 
have  been  employed  in  the  sensitivity  analysis.  Each  accumulation 
method  has  produced  a  corresponding  set  of  deviation  measures.  The 
seven  resultant  types  of  measures  are: 

1.  The  frequency  of  positive  deviations  —  the  propor¬ 
tion  of  basic  personnel  groups  for  which  positive 
differences  between  actual  and  authorized  personnel 
stocks,  or  surpluses,  are  observed. 

2.  The  frequency  of  negative  deviations  —  the  propor¬ 
tion  of  basic  personnel  groups  for  which  negative 
differences  between  actual  and  authorized  personnel 
stocks,  or  shortages,  are  observed. 
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3. 


The  average  positive  deviation  the  average  number 

of  surplus  personnel  observed  he  basic  personnel 

groups  experiencing  positive  dir..  ..rences  between 
actual  and  authorized  personnel  stocks. 

4.  The  average  negative  deviation  —  the  average  size 
of  the  personnel  shortage  observed  in  the  basic 
personnel  groups  experiencing  negative  differences 
between  actual  and  authorized  personnel  stocks. 

5.  The  maximum  positive  deviation  —  the  greatest 
number  of  surplus  personnel  observed  in  any  of  the 
basic  personnel  groups  experiencing  positive  differ¬ 
ences  between  actual  and  authorized  personnel  stocks. 

6.  The  maximum  negative  deviation  —  the  largest  per¬ 
sonnel  shortage  observed  in  any  of  the  basic  per¬ 
sonnel  groups  experiencing  negative  differences 
between  actual  and  authorized  personnel  stocks. 

7.  The  root-mean-squared  deviation  (RMS)  —  defined  as 

N  2  U 

RMS  =  (  Z  AT7N)  ,  where 
i=l 

A.  =  the  difference  between  the  actual  and  author¬ 
ized  personnel  stocks  for  basic  personnel 
group  i ,  and 

N  =  the  number  of  basic  personnel  groups  included 
in  the  more  highly  aggregated  personnel  col¬ 
lection. 

This  measure  attaches  equal  weight  to  all  surpluses 
and  shortages  of  the  same  size.  However,  proportion¬ 
ately  greater  weight  is  attached  to  large  deviations 
than  to  small  deviations. 

The  mobility  measures  used  in  the  sensitivity  analysis  examine  the 
number  of  personnel  movements  involved  in  implementing  the  assignment 
decisions  made  to  ISEM-P  to  fill  the  detailed  manpower  authorizations. 
The  general  measure  of  personnel  mobility  that  has  been  applied  to  the 
various  collections  of  personnel  described  above  is  the  Permanent  Change 
of  Station  (PCS)  rate  —  the  ratio  of  the  number  of  personnel  in  a  col¬ 
lection  who  are  involved  in  PCS  transfers  among  bases  to  the  total 
population  of  the  collection.  Separate  computations  of  the  PCS  rate 
are  performed  for  transfers  from  the  CONUS  to  overseas,  transfers  from 
overseas  to  the  CONUS,  transfers  within  the  CONUS,  and  total  transfers 
throughout  the  Air  Force. 


The  accession/ retention  measures  investigate  the  procurement  of 
new  personnel  and  the  reenlistment  of  current  personnel  within  per¬ 
sonnel  categories  differentiated  on  the  basis  of  skill  and  grade. 

Thus,  for  each  personnel  category  of  this  type  discussed  above,  the 
accession/retention  measure  calculated  for  the  sensitivity  analysis 
is  the  accession  rate  —  the  ratio  of  the  number  of  personnel  enlist¬ 
ing  or  reenlisting  in  the  category  to  the  total  stock  of  personnel  in 
the  category. 

The  training  measures  indicate  the  volume  of  training  performed 
by  the  initial  training  schools  and  the  technical  schools,  relative 
to  the  manpower  authorizations  of  the  skills  served  by  the  school. 

Thus,  for  each  school,  or  for  each  combination  of  schools  specified 
above,  six  types  of  training  measures  have  been  developed  for  use  in 
the  sensitivity  analysis: 

1.  The  ratio  of  the  total  number  of  personnel  entering 
the  school (s)  during  each  simulated  year,  to  the 
total  manpower  authorization  of  the  corresponding 
skill  (s)  for  the  year. 

2.  The  ratio  of  the  maximum  number  of  personnel  enter¬ 
ing  the  school (s)  during  any  month  in  each  simulated 
year,  to  the  total  manpower  authorization  of  the 
corresponding  skill (s)  for  the  year. 

3.  The  ratio  of  the  total  number  of  personnel  enrolled 
in  the  school (s)  during  each  simulated  year,  to  the 
total  manpower  authorization  of  the  corresponding 
skill (s)  for  the  year. 

4.  The  ratio  of  the.  maximum  number  of  personnel  enrolled 
in  the  school (s)  during  any  month  in  each  simulated 
year,  to  the  total  manpower  authorization  of  the 
corresponding  skill(s)  for  the  year. 

5.  The  number  of  months  in  each  simulated  year  during 
which  a  queue  of  personnel  is  awaiting  entry  into 
the  school (s). 

6.  The  ratio  of  the  maximum  number  of  personnel  delayed 
in  a  queue  awaiting  entry  into  the  school  (s)  during 
any  month  of  each  simulated  year,  to  the  total  man¬ 
power  authorization  for  the  corresponding  skill (s) 
for  the  year. 

Finally,  the  status  measures  examine  the  composition  of  the  proto¬ 
type's  stock  of  personnel  relative  to  personnel  types,  grades,  and  year 
groups.  Specifically,  four  different  types  of  measures  have  been  devel¬ 
oped  for  each  simulated  year: 
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1.  The  proportions  of  airmen  and  officers  in  the  total 
stock  of  personnel. 

2.  Relative  frequency  distributions  of  the  airman  and 
officer  populations  across  year  groups. 

3.  Relative  frequency  distributions  of  the  airman  and 
officer  populations  across  grades. 

4.  Relative  frequency  distributions  of  the  airman  and 
officer  populations  in  each  grade,  across  year  groups. 

Thus,  for  each  simulated  year,  the  composition  of  the  personnel  stock 
is  described  in  terms  of  15  different  sets  of  proportions. 


5.2  Sensitivity  Evaluation 


All  of  the  performance  measures  discussed  in  the  preceding  section 
describe  the  results  produced  by  ISEM-P  in  a  single  simulation  of  the 
behavior  of  the  AFMPS.  Evaluating  the  prototype's  sensitivity  to 
adjustments  in  the  value  of  its  structural  parameters  entails  comparing 
the  values  attained  by  the  various  performance  measures  in  analogous 
simulations.  Specifically,  such  evaluation  involves  examining  the  dif¬ 
ferences  between  the  magnitudes  of  the  performance  measures  observed 
with  the  initial  specification  of  parameter  values,  and  the  sizes  of 
the  same  performance  measures  occurring  with  a  modified  set  of  param¬ 
eter  values  associated  with  one  of  the  36  sensitivity  issues,  in  a 
standard  operational  situation  described  by  one  of  the  five  baseline 
scenarios . 

To  provide  perspective  to  the  examination  of  the  observed  differ¬ 
ences  in  the  magnitudes  of  the  various  performance  measures  —  and,  in 
so  doing,  to  focus  the  sensitivity  evaluation  on  differences  that  are 
distinctive  —  the  differences  in  size  computed  for  a  performance 
measure  of  any  level  of  aggregation  have  been  adjusted  to  account  for 
the  difference  in  magnitude  calculated  for  the  same  measure  at  the 
next  higher  level  of  aggregation.  Thus,  the  numbers  directly  consid¬ 
ered  in  the  sensitivity  analysis  actually  indicate  the  residual  vari¬ 
ability  of  the  performance  measures  after  the  differences  arising  at 
the  next  higher  level  of  aggregation  have  been  taken  into  account. 
Within  this  analytic  framework,  the  expanding  degrees  of  detail  pro¬ 
vided  at  successively  lower  levels  of  aggregation  of  the  various 
performance  measures  essentially  establish  a  contextual  hierarchy 
for  the  interpretation  and  analysis  of  the  measures. 

However,  even  with  this  hierarchical  structure,  the  sheer  volume 
of  information  available  for  consideration  in  an  analysis  of  even  a 
single  sensitivity  issue  within  the  context  of  a  single  baseline 
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scenario  is  so  great  that  the  development  of  a  parsimonious  approach 
for  examining  this  evidence  has  been  imperative.  Consequently, 
detailed  consideration  of  the  computed  differences  in  the  sizes  of 
performance  measures  has  been  restricted  to  only  those  differences 
that  are  sufficiently  large  to  be  indicative  of  notable  disparities 
in  the  performance  of  the  prototype.  The  assessments  of  sensitivity 
developed  in  this  study  are,  therefore,  based  exclusively  on  analyses 
of  those  performance  measures  in  which  exceptional  differences  have 
occurred. 

For  the  status  measures,  the  existence  of  notable  differences 
has  been  determined  by  computing  chi-square  statistics  summarizing 
the  observed  differences  between  pairs  of  analogous  frequency  distri¬ 
butions.  Whenever  the  values  of  the  statistics  are  significantly 
different  from  zero  at  the  5  percent  level  of  confidence,  the  corre¬ 
sponding  differences  are  judged  to  be  exceptional. 

For  the  deviation,  mobility,  accession/retention,  and  training 
measures,  it  has  not  been  possible  to  derive  such  definitive  indi¬ 
cators  of  the  existence  of  notable  differences.  These  other  measures 
neither  conform  to,  nor  can  they  be  transformed  to  permit,  the  calcu¬ 
lation  of  commonly  tabulated  indicators  of  statistical  significance. 
Consequently,  based  on  an  intensive  review  of  the  differences  observed 
for  these  measures  in  a  selected  sample  of  pairs  of  analogous  simula¬ 
tions,  critical  values  have  been  determined  for  each  of  these  perform¬ 
ance  measures  at  each  possible  level  of  aggregation.  Computed  differ¬ 
ences  in  excess  of  the  pertinent  critical  values  are  then  considered 
to  be  exceptional. 

By  applying  the  basic  approach  outlined  above,  a  comprehensive 
exception  report  is  developed  for  each  of  the  36  sensitivity  issues 
in  the  context  of  each  of  the  operational  situations  depicted  in  the 
five  baseline  scenarios.  Systematic  examination  of  each  of  these 
exception  reports  then  produces  a  judgment  concerning  the  relative 
sensitivity  of  the  prototype  with  regard  to  each  sensitivity  issue 
in  each  operational  situation.  This  judgment  is  formed  by  consider¬ 
ing  three  characteristics  of  the  set  of  notable  differences  identified 
for  all  of  the  performance  measures  in  the  exception  report: 

1.  The  number  of  notable  differences  observed  for  each 
type  of  performance  measure,  and  for  all  performance 
measures  as  a  group. 

2.  The  pattern  produced  by  the  observed  notable  differ¬ 
ences  within  the  hierarchical  framework  defined  by 
the  various  levels  of  aggregation  and  degrees  of 
detail. 

3.  The  magnitudes  of  the  observed  notable  differences 
relative  to  their  respective  critical  values. 
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Fortunately,  all  three  characteristics  have  been  highly  correlated  in 
virtually  all  of  the  exception  reports  developed  in  the  sensitivity 
analysis  of  ISEM-P.  The  number,  the  interrelatedness,  and  the  sizes 
of  the  notable  differences  identified  in  each  exception  report  have 
exhibited  remarkable  consistency.  Consequently,  the  judgments  embodied 
in  the  sensitivity  evaluations  presented  in  the  following  section  are 
essentially  independent  of  any  arbitrary  determinations  of  the  relative 
importance  of  the  three  characteristics  listed  above.  Virtually  ident¬ 
ical  assessments  of  the  relative  sensitivity  of  the  prototype  with 
regard  to  the  various  sensitivity  issues  would  be  developed  for  any 
reasonable  specification  of  the  comparative  importance  of  those  char¬ 
acteristics. 


6.0  RESULTS  OF  THE  ANALYSIS 


A  summary  of  the  overall  results  derived  by  applying  the  analytic 
methodology  outlined  in  Section  5.0  to  the  36  sensitivity  issues 
defined  in  Section  4.1,  within  the  context  of  the  five  baseline  sce¬ 
narios  specified  in  Section  4.2,  is  presented  in  Table  6.  For  three 
of  the  180  possible  combinations  of  the  sensitivity  issues  and  base¬ 
line  scenarios,  application  of  ISEM-P  is  impracticable  due  to  the 
unavailability  of  sufficient  core  storage  capacity  in  the  present 
AFHRL  computer.  For  two  other  combinations,  the  bases  whose  represen¬ 
tations  are  stipulated  for  deletion  from  the  prototype  by  the  sensi¬ 
tivity  issues  are  critical  to  simulation  of  the  operational  situation 
described  by  the  base  closure  scenario.  Thus,  the  results  of  a  total 
of  175  simulations  developed  using  ISEM-P  are  reported  in  the  table. 

For  virtually  all  of  the  sensitivity  issues  examined  in  this 
study,  the  outcomes  produced  by  the  prototype  exhibit  remarkable  con¬ 
sistency  across  all  five  baseline  scenarios.  For  only  two  issues  — 
the  deletion  of  Base  7,  and  the  reduction  of  the  length  of  the  simula¬ 
tion  from  5  years  to  3  years  —  does  the  performance  of  ISEM-P  display 
appreciably  greater  sensitivity  within  the  context  of  one  of  the  base¬ 
line  scenarios  than  it  reveals  in  the  operational  situations  described 
by  the  other  four.  Moreover,  the  observed  diversity  in  performance  is 
entirely  reasonable  in  these  two  instances. 

Deleting  the  representation  of  Base  7  from  the  prototype  produces 
substantial  changes  in  the  performance  of  ISEM-P  for  the  baseline  sce¬ 
nario  involving  reduction  of  the  aircraft  utilization  rate  of  all  B-52 
aircraft,  while  it  evokes  only  moderate  responses  with  the  other  four 
scenarios.  However,  Base  7  is  a  SAC  operations  base  in  the  CONUS  to 
which  a  B-52  squadron  is  assigned.  Thus,  the  differential  responsive¬ 
ness  of  the  performance  of  ISEM-P  observed  for  this  modification  of 
its  structural  assumptions  is  perfectly  logical.  Moreover,  since 
this  sensitivity  issue  is  the  only  one  focusing  on  the  operation  of 
B-52  aircraft,  the  absence  of  analogous  response  patterns  for  other 
sensitivity  issues  is  also  sensible. 

Similarly,  abbreviating  the  length  of  the  simulation  from  5  years 
to  3  years  elicits  noticeably  greater  changes  in  the  prototype's  per¬ 
formance  for  the  baseline  scenarios  involving  unchanging  mission  plans 
and  authorization  ceilings  over  time,  than  it  induces  with  the  remain¬ 
ing  four  scenarios.  The  changes  in  performance  occasioned  by  adjusting 
the  length  of  the  simulation  all  arise  from  the  manner  in  which  ISEM-P 
anticipates,  and  formulates  plans  with  reference  to,  the  end  of  the 
simulation.  Since  these  effects  can  rationally  be  expected  to  be  more 
conspicuous  when  no  other  stimuli  affect  the  performance  of  the  proto¬ 
type,  the  observed  response  pattern  is  completely  understandable. 


Table  6:  Overall  Results  of  Sensitivity  Analysis 


_ _  Scenario  _ _ _ 

Constant  "~T~  Ban*  I  '  Reduced  1  Reduced  Aircraft  V  Reduced 


More  detailed  compilations  of  the  results  derived  in  the  sensi¬ 
tivity  analysis  are  presented  in  Tables  7  through  11.  In  particular, 
each  of  these  tables  summarizes  the  outcomes  observed  for  one  of  the 
five  basic  types  of  performance  measures  delineated  in  Section  5.1. 
Thus,  the  results  obtained  for  the  deviation  measures,  the  mobility 
measures,  the  accession/retention  measures,  the  training  measures, 
and  the  status  measures  are  reported  in  Table  7,  Table  8,  Table  9, 

Table  10,  and  Table  11,  respectively. 

The  evidence  displayed  in  these  tables  reveals  the  same  general 
consistency  across  baseline  scenarios  discerned  in  Table  6.  Further, 
the  data  also  discloses  prevalent  uniformity  in  the  degree  of  respon¬ 
siveness  observed,  for  the  same  sensitivity  issues,  across  the  various 
types  of  performance  measures.  Almost  never  does  a  sensitivity  issue 
stimulate  predominantly  high  responses  for  one  type  of  performance 
measure,  while  generating  generally  low  respones  for  all  other  types 
of  measures.  Only  for  the  issue  involving  an  increase  in  the  main¬ 
tenance  manpower  factor  is  an  appreciably  greater  responsiveness 
observed  for  one  set  of  performance  measures  —  the  training  measures 
—  than  for  the  other  four  sets.  In  addition,  this  enhanced  sensitiv¬ 
ity  prevails  for  only  three  of  the  five  baseline  scenarios. 

Even  for  those  sensitivity  issues  where  different  degrees  of 
responsiveness  are  revealed  for  airmen  and  for  officers,  general  uni¬ 
formity  exists  in  the  patterns  of  responses  occurring  across  types 
of  performance  measures.  Specifically,  this  condition  prevails  for 
the  issues  involving:  decreasing  the  maintenance  manpower  factor, 
increasing  or  decreasing  the  base  support  coefficients,  increasing 
or  decreasing  retention  rates,  changing  the  initial  year  group  dis¬ 
tribution,  and  changing  the  initial  grade  distribution. 

The  tables  also  disclose  general  consistency  in  the  response 
patterns  observed  for  related  sensitivity  issues.  First,  consider- 
erable  symmetry  is  displayed  by  the  results  obtained  for  those  pairs 
of  sensitivity  issues  that  examine  both  an  increase  or  a  decrease  in 
the  value  of  the  same  parameter,  and  for  which  high  or  moderate  overall 
responsiveness  has  been  revealed.  Thus,  increasing  or  decreasing  the 
base  support  coefficients  stimulates  corresponding  increases  or 
decreases  in  personnel  shortages,  surpluses,  and  movements  between 
bases.  Moreover,  in  both  cases,  the  most  notable  responses  consist 
of  changes  in  airman  shortages.  Similarly,  increases  or  decreases 
in  retention  rates  induce  increases  or  decreases,  respectively,  in 
personnel  shortages  and  evoke  parallel,  but  opposite,  responses  in 
all  of  the  other  types  of  performance  measures. 
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_ Baseline  Scenario _ _ _ 

Constant  I  Base  [  Reduced  [ Reduced  Aircraft  I Reduced 


Low  sensitivity  TiiDe“in*C0NUS/Tinic^5n“Stat  ion 

Moderate  sensitivity  ^Major  Commands 

High  sensitivity 

Analysis  infeasible:  computer  core  storage  limitations 

Analysis  infeasible:  deleted  base  critical  to  base  closure  scenario 


Table  8:  Mobility  Measure  Results 


Low  sensitivity  Time-ln-CCNUS/Tiae- On-Station 

Moderate  sensitivity  '’Major  Commands 

High  sensitivity 

Analysis  infeasible:  computer  core  storage  limitations 

Analysis  Infeasible:  deleted  base  critical  to  base  closure  scenario 


Table  8  (continued) 
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Low  sensitivity  Tlme-ln-CONUS/Time-On-Stat ion 

Moderate  sensitivity  ^Major  Commands 

High  sensitivity 

Analysis  infeasible:  computer  core  storage  limitations 

Analysis  infeasible:  deleted  base  critical  to  base  closure  scenario 


Baseline  Scenario 


Table  10:  Training  Measure  Results 


Low  sensitivity  aTine-ln-CONUS/Tltoe-On-Statloo 

Moderate  sensitivity  ^Malor  Commands 

High  sensitivity 

Analysis  Infeasible:  computer  core  storage  limitations 

Analysis  Infeasible:  deleted  base  critical  to  base  closure  scenario 


Table  10  (continued) 
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Table  11  (continued). 


Similarly,  within  sets  of  analogous  sensitivity  issues,  broadly 
comparable  patterns  of  responses  uniformly  arise.  Thus,  for  those 
sets  of  sensitivity  issues  representing  a  natural  progression  of 
increasingly  severe  modifications  of  a  single  structural  assumption, 
the  same  fundamental  pattern  of  responses  is  exhibited  for  all  issues 
in  the  set.  Most  importantly,  the  strength  of  the  response  pattern 
consistently  increases  as  the  severity  of  the  parametric  modifications 
increases.  Such  sequences  of  response  patterns  occur  for  two  distinct 
sets  of  sensitivity  issues:  the  three  issues  involving  progressively 
greater  consolidations  of  skill  codes,  and  the  three  issues  comprising 
successively  more  inclusive  consolidations  of  CONUS  bases. 

Further,  where  groups  of  especially  comparable  sensitivity  issues 
can  be  distinguished  within  larger  sets  of  analogous  issues,  distinc¬ 
tive  differences  can  frequently  be  discerned  among  the  general  response 
patterns  associated  with  the  various  groups  of  highly  comparable 
issues.  In  particular,  within  the  set  of  sensitivity  issues  involving 
deletion  of  the  representations  of  certain  individual  bases,  a  high 
degree  of  consistency  pertains  in  the  response  patterns  derived  for 
three  distinguishable  groups,  while  notable  disparities  prevail  among 
the  common  response  patterns  exhibited  by  the  different  groups.  Thus, 
a  pattern  of  moderately  strong  responses  is  observed  for  the  three 
Issues  involving  the  deletion  of  representations  for  CONUS  bases, 
specifically  Base  6,  Base  7,  and  Base  12.  Because  deleting  the  repre¬ 
sentation  for  any  of  these  bases  reduces  the  sizes  of  certain  pools 
of  personnel  that  serve  as  sources  of  replacements  for  personnel 
returning  from  overseas,  the  predominant  feature  of  this  response 
pattern  is  the  high  degree  of  sensitivity  displayed  by  the  deviation 
measures.  In  contrast,  a  different  moderately  strong  response  pattern 
exists  for  the  two  issues  concerned  with  the  deletion  of  representa¬ 
tions  for  the  PACAF  bases:  Base  16  and  Base  17.  In  this  response 
pattern,  the  highest  degree  of  sensitivity  is  revealed  by  the  mobility 
measures,  because  deletion  of  either  PACAF  base  diminishes  the  volume 
of  personnel  required  to  rotate  periodically  through  tours  of  overseas 
duty.  Finally,  a  considerably  weaker  pattern  of  responses,  also 
focusing  on  the  mobility  measures,  is  associated  with  the  two  issues 
Involving  the  deletion  of  representations  for  the  two  USAFE  bases: 

Base  14  and  Base  15.  This  result  pertains  for  two  reasons.  First, 
the  maximum  permissible  tour  lengths  for  the  USAFE  bases  are  uniformly 
greater  than  the  maximum  tour  length  for  Base  17,  and  are  never  less 
than  the  maximum  tour  length  for  Base  16.  In  addition.  Base  16  con¬ 
tains  a  larger  number  and  wider  variety  of  missions,  and  hence  accom¬ 
modates  more  personnel,  than  either  USAFE  base.  Consequently,  the 
USAFE  bases  included  in  ISEM-P  require  smaller  and  less  frequent 
rotation  of  personnel  than  is  needed  by  the  PACAF  bases  contained 
in  the  prototype. 

Comparable  disparities  in  response  patterns  are  observed  for  four 
different  sets  of  sensitivity  Issues  addressing  alternative  modifica¬ 
tions  of  the  mission  specifications  and  manning  standards  embodied  in 
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the  prototype.  First,  a  high  degree  of  sensitivity  is  revealed  for 
the  issues  concerned  with  changes  in  the  base  support  coefficients. 

A  considerably  weaker  response  pattern  prevails  for  the  second  set 
of  Issues,  involving  changes  in  the  maintenance  manpower  factor.  The 
third  set  of  issues,  examining  changes  in  standard  flying  hours, 
exhibit  only  slight  sensitivity.  Virtually  no  responsiveness  occurs 
for  the  fourth  set  of  issues,  pertaining  to  modifications  of  the 
flight  plan  coefficient,  the  munition  load  factor,  and  the  work  load 
factor. 

Most  significantly,  overarching  all  of  the  consistency  across 
baseline  scenarios  and  within  sets  of  sensitivity  issues  discussed 
above,  the  results  presented  in  Tables  6  through  11  disclose  substan¬ 
tial  differences  in  the  relative  responsiveness  of  the  performance 
of  ISEM-P  to  the  various  changes  in  parameter  values  associated  with 
the  different  sets  of  issues.  Specifically,  the  results  reveal  that 
the  performance  of  the  prototype  is  highly  sensitive  to: 

1.  Changes  in  the  initial  conditions  established  in  the 
grade  distribution  and  the  year  group  distribution 
entered  into  ISEM-P  at  the  beginning  of  each  simula¬ 
tion. 

2.  Consolidations  of  the  skill  categories  identifying 
the  groups  of  personnel  addressed  in  ISEM-P. 

3.  Changes  in  the  retention  rates  controlling  the  attri¬ 
tion  of  personnel  in  ISEM-P. 

4.  Changes  in  the  base  support  coefficients  determining 
the  manpower  requirements  for  the  base  support  skills 
In  ISEM-P. 

Most  modest,  but  still  notable,  sensitivity  is  observed  for: 

1.  Changes  in  the  number  of  bases  represented  in  ISEM-P, 
achieved  either  through  deletion  or  consolidation  of 
the  representations  of  individual  bases.  The  differ¬ 
ences  in  the  observed  sensitivity  of  the  performance 
of  the  prototype  to  these  two  distinct  types  of 
adjustments  appears  to  be  primarily  attributable  to 
differences  in  the  severity  of  the  adjustments  con¬ 
sidered  in  the  analysis.  The  simultaneous  deletion 
of  several  bases  has  never  been  examined,  while  the 
consolidation  of  as  many  as  ten  bases  has  been  simu¬ 
lated.  Only  for  such  extreme  consolidation  of  bases 
has  high  sensitivity  been  observed. 

2.  Changes  in  the  maintenance  manpower  factor  determining 
the  manpower  requirements  for  maintenance  personnel  in 
ISEM-P. 
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These  sets  of  sensitivity  issues  clearly  indicate  the  attributes  of 
the  prototype  for  which  it  is  empirically  important  to  develop  accu¬ 
rate  representations  of  AFMPS  decision  rules  and  operating  conditions. 
Only  with  correct  characterizations  in  these  critical  areas  can  it 
reasonably  be  expected  that  the  outputs  derived  by  ISEM-P  might 
exhibit  reasonable  correspondence  to  the  actual  outcomes  that  would 
be  observed  for  the  real  AFMPS  in  similar  situations. 
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7.0  CONCLUSIONS  AND  RECOMMENDATIONS 


The  sensitivity  analysis  of  ISEM-P  conducted  in  this  study  reveals 
remarkable  consistency  in  the  responsiveness  of  the  prototype's  per¬ 
formance  to  systematic  adjustments  in  the  values  of  its  parameters. 
Specifically: 

1.  For  each  of  the  36  sensitivity  issues  examined  in  the 
analysis,  considerable  uniformity  exists  in  the  degree 
of  responsiveness  observed  for  all  five  types  of  per¬ 
formance  measures  employed  in  the  study. 

2.  The  response  patterns  derived  for  each  of  the  sensi¬ 
tivity  issues  exhibit  singular  uniformity  across 
the  five  baseline  scenarios  defining  the  operational 
situations  for  which  simulations  have  been  developed 
throughout  the  analysis. 

3.  General  consistency  prevails  in  the  response  patterns 
observed  for  related  sensitivity  issues.  Symmetric 
response  patterns  occur  for  pairs  of  sensitivity 
issues  addressing  opposite  adjustments  in  the  value 
of  a  single  parameter;  and  increasingly  strong 
response  patterns  arise  for  increasingly  severe 
parametric  modifications. 

4.  For  groups  of  particularly  comparable  sensitivity 
Issues  within  larger  sets  of  analogous  issues,  uni¬ 
formity  exists  in  the  response  patterns  developed  for 
the  especially  comparable  issues,  while  distinctive 
differences  occur  among  the  general  response  patterns 
associated  with  the  various  homologous  groups. 

Precisely  because  of  this  general  consistency  exhibited  by  the  analytic 
results  among  performance  measures,  across  baseline  scenarios,  and 
within  sets  of  related  sensitivity  issues,  it  is  possible  to  discern 
dramatic  differences  in  the  relative  responsiveness  of  the  performance 
of  the  prototype  for  the  various  sets  of  related  sensitivity  issues. 
This  evidence  indicates  that  the  performance  of  ISEM-P  is  highly  sensi¬ 
tive  to: 

1.  Changes  in  the  initial  year  group  distribution. 

2.  Changes  i.i  the  initial  grade  distribution. 

3.  Consolidations  of  skill  categories. 

4.  Changes  in  personnel  retention  rates. 

5.  Changes  in  base  support  coefficients. 
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In  addition,  moderate  sensitivity  is  revealed  for: 

1.  Deletion  of  representations  for  certain  bases. 

2.  Modest  consolidations  of  base  representations. 

3.  Changes  in  the  maintenance  manpower  factor. 

For  all  other  sets  of  sensitivity  issues  examined  in  the  analysis,  the 
performance  of  ISEM-P  exhibits  low  sensitivity. 

It  is  important  to  realize  that  a  determination  of  high,  or  mod¬ 
erate,  responsiveness  of  the  prototype's  performance  for  any  sensitiv¬ 
ity  issue  does  not  indicate  that  the  values  initially  specified  in 
ISEM-P  for  the  parameters  associated  with  that  issue  are  incorrect. 
Rather,  such  a  determination  merely  indicates  that  formulation  of  an 
accurate  representation  of  the  corresponding  AFMPS  decision  rules  and 
operating  conditions  is  crucial  to  the  derivation  of  outputs  that  con¬ 
form  acceptably  to  the  actual  outcomes  that  would  occur  in  the  real 
AFMPS  in  analogous  situations. 

From  this  perspective,  the  analysis  strongly  suggests  that  it 
would  be  beneficial  to  validate  the  accuracy  of  the  representations 
contained  in  ISEM-P  for  the  AFMPS  decision  rules  and  operating  condi¬ 
tions  associated  with  those  sensitivity  issues  for  which  the  perform¬ 
ance  of  ISEM-P  has  been  determined  to  display  high  responsiveness. 

More  specifically,  it  is  recommended  that  research  efforts  should  be 
devoted  to  identifying  the  precise  decision  rules  employed  by  the 
AFMPS,  and  the  precise  conditions  under  which  the  AFMPS  operates, 
when  addressing  the  sets  of  sensitivity  issues  listed  previously,  for 
which  the  performance  of  the  prototype  has  exhibited  high,  or  moderate, 
responsiveness  in  this  sensitivity  analysis.  Then,  the  corresponding 
representations  of  those  decision  rules  and  operating  conditions  cur¬ 
rently  embodied  in  ISEM-P  should  be  meticulously  reviewed,  and  revised 
or  replaced  as  necessary,  to  assure  their  satisfactory  conformance  to 
the  actual  rules  and  conditions  prevailing  in  the  real  AFMPS.  Achiev¬ 
ing  these  research  objectives  will  provide  the  dual  benefits  of  improv¬ 
ing  the  quality  of  the  outputs  produced  by  ISEM-P  as  simulations  of 
actual  AFMPS  performance  and  of  increasing  confidence  in  the  potential 
usefulness  of  the  ISEM  concept  as  an  analytic  foundation  for  AFMPS 
planning  and  policy  formulation. 
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